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diffusion  methods  derived  earlier  for  message  routing,  can  be  used. 
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1«-  INTRODUCTION 


1,1,-  General  considerations 

A computer-communication  system  consists  of  several  computers 
interconnected  by  communication  channels.  It  is  usually  referred  as  a 
network  in  which  the  nodes  represent  the  computers  and  the  links  represent 
the  interconnecting  channels.  Messages  are  originated  at  some  node  and 
have  to  reach  some  other  destination  node  according  to  some  routing 
strategy  which  will  try  to  use  the  network  in  an  efficient  way. 

The  computer  network  considered  here  is  assumed  to  operate  in  the 
"store  and  forward”  model  a message  generated  at  a computer  center  will 
be  directed  into  the  appropiate  outgoing  channel  according  to  the  routing 
policy  and  will  be  transmitted  over  this  channel  if  it  is  free  for 
transmission.  If  the  channel  is  busy,  the  message  will  be  stored  at  the 
node  in  some  buffer  joining  other  possible  waiting  messages.  When  the 
channel  becomes  free  one  of  the  wating  messages  is  transmitted  through 
the  channel  according  to  some  queueing  priority  basis.  This  will  be 
assumed  "first-come,  first-served"  (FCFS)  as  it  is  usually  referred  in 
queueing  literature.  £7,  12,  22 j 

The  queue  of  messages  at  each  node  constitutes  a queueing  process 
of  discrete  nature  n^(t)  such  that  n^(t)  ■ A^(t)  - D^(t)  where  A^(t)  and 
D^(t)  represent  respectively  the  arrival  and  departure  processes  at  node 
i,  namely  the  number  of  arrivals  and  departures  at  the  queue  i up  to  the 


time  t 
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In  order  to  provide  mathematical  tractability  a model  for  the  network 
of  queues  has  to  be  established. 

The  type  of  queue  depends  on  the  statistics  of  the  interarrival  and 
service  times.  The  simplest  type  of  queues  is  the  M/M/1  queue  (•),  This 
means  that  the  interarrival  and  service  times  are  independent  and  obey  an 
exponential  distribution  or  equivalently  that  the  arrival  and  service 
rates  follow  a Poisson  distribution.  Because  of  the  Poisson  property 
(see  [17]  for  example)  the  expressions  of  the  system  dynamics  are  easy 
to  obtain  and  the  steady-state  distribution  of  the  queue  length  pn  is  quite 
straightforward  £?J  » 

Pn-U  -/»)/"  > n - 0,  1,  2,  ...  (1-la) 

f - X/^l  -*  1 (1-lb) 

where  A and  fj,  are  respectively  the  arrival  and  service  constant  rates 
expressed  in  messages/unit  time. 

The  condition  A<  }X  is  necessary  to  assure  that  the  steady-state 
is  reached  and  the  process  does  not  blow  up. 

The  expression  (1-1)  allows  to  calculate  the  average  queue  length 


(*)  In  queue  literature  it  is  usual  to  denominate  a queue  by  the 

symbols  A/B/X/Y/Z  where  A indicates  the  interarrival-time  distribution 
3 the  service— time  distribution,  X the  number  of  parallel  servers 
Y the  restriction  on  the  queue  length  capacity  and  Z the  queue 
discipline.  Often  the  last  two  symbols  are  omitted  and  it  is 
understood  that  Y = 00  , that  is  no  restrictions  on  the  maximun 
queue  length  and  Z = FCFS  ("first  come  first  served"). 

The  symbols  used  for  A and  B ares  D for  deterministic,  M for 
exponential,  for  erlagian  type  k,  G for  general  and  GI  for  general 
independent.  (Reference  [ 7]  ) 
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n = Z!  n pp.  From  the  same  expression,  the  waiting  time  distribution 
(including  also  the  time  spent  in  the  service,  i.e,  transmission  through 
the  channel)  can  be  obtained  and  from  this  the  average  waiting  time  can 
be  drawn.  An  alternate  way  is  using  Little’s  formula  £15]  which  states 
that  the  average  number  of  customers  in  a queueing  system  is  equal  to  the 
average  arrival  rate  of  customers  to  that  system,  times  the  average  time 
spent  in  the  system: 


n = e[ T ] 

so  that  E [ T ] can  be  calculated  yielding 


(1-2) 


E[ T 1 * (1-3> 

In  the  computer  network  e[  t|  is  the  average  delay  a message  suffers 
going  from  one  node  to  another  and  includes  the  average  waiting  time  at 
the  entering  node  plus  the  average  transmission  time  in  the  channel. 

When  a network  of  queues  is  considered,  the  messages  arriving  at  a 
new  node  along  their  path  lose  the  independence  property  mentioned  above 
because  of  the  strong  dependency  between  interarrival  times  and  lengths  of 
adjacents  messages.  For  example  if  a message  at  node  i has  a length  of  si 
seconds  and  arrives  at  node  3 at  time  t^,  it  is  clear  that  during  the 
interval  (t^,  t]_,  ♦ s^)  no  messages  can  arrive  at  j from  i since  they  are 
transmitted  in  a sequential  order,  and  therefore  the  independence  assumption 
is  no  longer  valid.  This  makes  the  analysis  very  complicated  from  a 
mathematical  point  of  view,  Kleinroek  £llj  overcomes  this  difficulty  by 
introducing  the  “independence  assumppticn”  which  specifies  that  each  time 
the  messages  enter  a new  node  they  are  assigned  new  independent  lengths 
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( exponentially  distributed ) . 

With  this  assumption  an  expression  for  the  average  delay  over  the 
entire  network  can  be  found  in  terms  of  the  average  delay  in  each  link. 
The  desired  routing  strategy  is  that  which  minimises  the  average  delay 
and  procedures  to  obtain  the  optimal  strategy  have  been  derived  for 
example  in  f l]  . 


1,2.-  Existing  Models  for  Networks  of  Queues 


One  of  the  earliest  models  was  established  by  Jackson  8 . He 

considered  an  arbitrary  network  of  N nodes  each  of  them  consisting  of 
rA  servers  with  constant  exponential  mean  service  time  . Messages 
arrive  at  each  node  i from  outside  the  network  according  to  an  homogeneous 
Poisson  process  of  rate  A^,  Each  message  upon  being  served,  is  directed 
to  some  other  node  j according  to  some  probability  or  leaves  the 
system  with  probability  1 - Z-  0^.  The  transition  probabilities  0^ 
are  assumed  corresponding  to  a 1st  order  Markov  chain.  The  total  arrival 
rate  at  each  node  i ["^  consists  of  the  sum  of  the  arrival  rate  from 
outside  the  network  (Poisson)  and  the  arrival  rates  from  other  nodes 
within  the  network! 


n.  - \ ♦ t rj  e 


>1 


Ji 


d-4) 


Jackson  showed  that  when  P < for  *11  1 as  far  *s  the  steady 
state  is  concerned,  the  network  behaves  as  if  all  nodes  were  independent 
Poisson  processes  M/M/r^  with  rate  P^,  Therefore  the  steady-state  joint 
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distribution  can  be  expressed  as  the  product  of  the  corresponding  marginal 
distributions,  and  expressions  for  the  queue  lengths  and  average  delays 
can  be  easily  found. 

In  a subsequent  work  £9]  Jackson  considered  a more  general  network 
in  which  the  arrival  process  still  being  Poisson,  is  allowed  to  have  a 
rate  dependent  on  the  total  number  of  customers  in  the  network.  Each  node 
has  r^  servers  and  the  service  time  is  exponentially  distributed  with  mean 
dependent  on  the  number  of  customers  at  that  node.  Still  the  joint 
distribution  factors  into  the  product  of  the  marginal  ones  and  each  node 
can  be  treated  independently, 

A modification  of  the  Jackson's  model  was  considered  by  Gordon  and 

Newell  [6]  . They  consider  a closed  system  of  queues  which  handles  a 

finite  and  fixed  number  of  customers.  This  model  can  be  made  equivalent 

N 

to  that  of  Jackson  by  assuming  = 0 for  all  i and  k9  ij  = 1* 

More  general  models  that  allow  a service  time  discipline  not 
necesarily  exponential,  have  been  considered  and  explicit  solutions  have 


been  obtained 


• M • 


In  all  cases  the  main  difficulty  comes  from  the  fact  that  there  is 
a very  large  system  of  equations  due  to  the  enormous  number  of  states. 

In  order  to  overcome  these  difficulties  and  break  away  from  the 
sometimes  too  simplistic  models  that  assume  exponential  service  time, 
different  approaches  to  network  analysis  have  been  made.  Thus  for  example 
Kingman  [lo]  has  shown  in  his  treatement  of  heavy  traffic  theory  that 
properties  of  nearly  saturated  queues  are  rather  insensitive  to  the 
specific  form  of  arrival  or  service  distribution. 
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The  heavy  traffic  approximation  is  based  upon  the  central  limit 


theorem.  This  leads  to  the  idea  of  approximating  a discrete-state  processes 
by  continuous-state  ones  which  have  been  oalled  diffusion  processes  and 
will  be  explained  in  a subsequent  section. 

The  idea  of  approximating  a discrete-state  process  by  a diffusion 
one  is  not  new,  (See  for  example  Feller  £3]  )•  Nonetheless  is  rather 

recent.  Thus  for  example,  Newell  £l6j  gives  an  extensive  treatement 
of  queues  with  time  dependent  arrival  rate  by  using  the  diffusion 
approximation.  Gave?  £ 4 j applies  diffusion  approximation  techniques  to 
the  waiting  time  in  a M/G/l  queue.  He  shows  that  the  waiting  time  is 
exponential  in  the  diffusion  approximation  provided  the  system  was 
initially  empty.  An  asymptotic  approximation  is  supplied  for  the  mean 
waiting  time  near  saturation  and  comparisons  are  made  with  the  exact 
solutions  provided  by  the  classical  methods  (see  £7]  for  example).  The 
results  show  to  be  rather  accurate  for  those  conditions, 

Gaver  and  Shedler  £ 5 ] have  applied  the  dif f us  ion  approximation 
to  evaluate  the  CPU  utilization  of  a multiprogrammed  system  represented 
by  a cyclic  queueing  model.  Solutions  appear  to  be  easier  than  the  classical 
ones  and  yet  the  accuracy  seems  quite  adequate  for  the  case  studied, 

Kobayashi  £l3,  14  j has  analyzed  a system  of  queues  by  diffusion 
methods.  His  model  is  based  on  the  Markovian  model  of  Jackson  (open  networks) 

and  Gordon  and  Newell  (closed  networns)  which  we  mentioned  earlier.  In  the 
first  paper  [l3]  and  based  upon  central  limit  theorem  arguments  he  finds 
the  steady-state  distribution  of  a single  queue,  and  a system  of  queues 
(open  and  closed)  assuming  independent  identically  distributed  interarrival 


raaawiitt 
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and  service  times  with  general  distributions.  In  the  second  paper  £l4j 
and  using  diffusion  methods  too,  the  transient  behavior  of  those  systems 
is  analyzed.  The  analysis  provides  an  estimation  of  the  transient  period 
which  shows  to  be  shorter  as  the  system  is  less  congested.  A comparison 
of  results  with  those  exactly  known  by  classical  methods  is  given  in  £19] 
and  they  show  to  be  rather  accurate  for  utilization  factors  near  1. 


1.3.-  Objetives  of  this  thesis 


As  it  was  pointed  out  in  the  proceeding  section  when  the  number  of 
states  of  a Markov  model  becomes  very  large,  although  finite,  the  search 
of  solutions  appears  quite  cumbersome.  The  procedure  of  approximating  the 
discrete-state  process  by  a diffusion  process  can  be  therefore  useful 
because  mathematical  methods  associated  with  a continuous  space  are  very 
often  more  easily  treated  than  those  in  a discrete-state  space.  In  a 
computer-communication  network  this  is  the  case  when  the  number  of  computer 
centers  is  relatively  large. 

The  purpose  of  this  thesis  is  to  consider  a general  type  of  computer 
network  and  by  using  diffusion  methods  find  a model  for  analysis  of  the 
behavior  of  the  network.  Then  a strategy  for  routing  messages  throughout 
the  system  in  an  efficient  way  is  to  be  found.  In  order  to  make  an  optimal 
use  of  the  network,  messages  shall  reach  their  destination  as  soon  as  possible 
and  thus  the  performance  criteria  for  routing  will  be  to  minimize  the  overall 


average  delay  on  the  entire  network. 


The  ideas  for  the  model  set  up  (Section  4,1)  resemble  some  those 


established  by  Segall  |^23j  and  have  been  taken  from  this  reference.  The 
mentioned  paper  deals  with  dynamic  routing  in  computer  networks  and  avoids 
the  "independence  assumption"  that  was  mentioned  earlier  although  the  model 
of  [23]  assumes  a deterministic  scheme  with  known  traffic  Inputs  whereas 
here  the  model  is  stochastic  in  the  sense  that  the  inputs  are  only  known 


in  terms  of  their  statistics 


2.-  THE  DIFFUSION  PROCESS 


2.1.-  The  random  walk  process  ^ 2 J 

It  is  introduced  here  the  concept  of  random  walk  as  a discrete-state 
discrete-time  Markov  process  for  the  diffusion  process  can  be  drawn  from 
it  in  the  limit.  Consider  the  time  divided  in  intervals  of  duration 
At  * 0,  At#  2 At,  ...  n At  •••  and  the  state  divided  in  intervals  of 
length  0 : 0,  Q , 2 0 , . . . k0  ....  At  time  t = 0 the  state  is  Xq  = kQ0. 
At  time  t = At  the  state  can  jump  one  step  Q upwards  with  probability  p, 
one  step  downwards  with  probability  q or  remain  the  same  with  probability 
1 - p - q.  No  other  transitions  are  allowed.  In  each  interval  of  time 
later  the  same  jumps  with  the  same  probabilities  can  happen  and  are 
independent  of  the  previous  jumps.  This  is  graphically  shown  in  Fig. 2.1 
and  can  be  considered  as  the  motion  of  a particle  in  a one-dimensional 
space.  If  the  particle  continues  to  move  indefinitely  the  random-walk 
is  said  to  be  unrestricted.  Nonetheless  it  is  frequently  necessary  to 
have  the  motion  restricted  in  some  way,  usually  by  the  presence  of 
"barriers''.  For  example  a random  walk  starting  at  the  origin  can  be 
restricted  to  move  between  an  upper  barrier  a > 0 and  a lower  barrier 
at  b < 0.  Several  types  of  barriers  are  encountered.  One  of  these  is  an 
"absorbing  barrier":  when  it  is  reached  the  particle  stays  there  and  the 
motion  ceases.  Another  type  is  a "reflecting  barrier"  defined  as  a state 
that  when  crossed  in  a given  direction,  say  downwards,  holds  the  particle 
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until  a positive  jump  occurs  and  brings  the  particle  out  of  the  barrier 
resuming  the  motion. 

We  shall  examine  here  the  properties  of  a random  walk  with  reflecting 
barriers.  It  is  of  interest  to  determine  the  steady-state  or  equilibrium 


Consider  the  random  walk  of  section  2,1,  Assume  that  0 and  At  go 
to  zero  so  that  n At  — t and  k0  — * x(t).  The  resultant  process  x(t) 
becomes  a continuous-sate  continuous- time . Markov  process.  It  is  shown 


in  Fig,  2.2 


x(t) 

state 


time 


Fig  2.2 » Diffusion  process  as  a limit  of  a random  walk 


Equation  (2-1)  can  be  rearranged  as: 


(n  At  ♦ At)  “ PkQ  (n  At)  * ^ 

- fpke(nAt)  - P(k.i)0<n  At)  \ ♦ 


P(k4l)e  (n  At)  - P k0  (n  At) 


V P ) p(k4l)0(nAt)  * 
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F$a 


-PjtgCnAt)!  ♦ (nAt)  - P(k-1)0  ("At)  J (2-2) 

When  At  becomes  very  small,  so  that  nAt  — t,  k0  x(t)  and  kQ0  — Xq 
the  state  probability:  p^tnAt)  — p(xjt/x0). 

Let  At  = K02  (K  being  a constant)  and  divide  both  sides  of  (2-2) 
by  At.  Then 

p(x»t  +At/x0)  - p(xjt/xo) 

St 

p + q 1 p(x+0;t/xo)  - p(x;t/xo)  p(xit/xg)  - p(x-0?t/xQ) 

= 2K~  ~Q~  0 " e 

■ « 

p - q 1 p(x+0;t/xo)  - p(x;t/x0)  _ p(x;t/x0)  - p(x-0jt/xQ) 

" ~2K  ~e~  ' 0 + q 

Taking  limits  when  At  — 0,  0 — 0 


(2-4) 


fcp(x;t/x0) 

= lim 

p + q 

i 

it 

0-o 

2K 

- lim 
0 —0 

p - q 
K0 

If 

0 

p-+  q 

K 

= cC 

and 

^0 

g_-  q 
K0 

If  lim  = oC  (2-4a) 

0—0  K 

*nd  ^i0  ^ ‘P  (2J*b) 

OC  and  J3  being  constants  then  (2-3)  becomes 

dp(x;t/x  ) ^)2p(xj t/x  ) ^p(xst/xQ) 

v? — ~ = ioc-™ — - /3  — (2-5) 

dt  2 Ax2  ' &x 

which  is  the  diffusion  equation  [ 2 j . 

For  the  conditions  (2-4)  to  be  satisfied,  the  probabilities  p and  q 
must  be  taken  as: 


(ec  + vf 

\/At> 

(2-6) 

(oc 

\/4t) 

(2-7) 

that  is  the  probabilities  of  jumping  upwards  and  downwards  have  to  be 
nearly  the  same,  the  difference  being  a term  that  tends  to  zero  as  V®* 
Notice  that  the  parameters  ji>  and  <X  are  respectively  the  incremental 
mean  and  variance  of  the  process  x(t)  per  unit  time  since 
E [x(t  + At)  - x(t)/x(t)]  = e-(p-q)— > U02)  =^‘At 

Var[x(t  + - x(t)/x(t)]=  02(p  ♦ q)  - 02(p  - q)2  — - 

— - 02k(  c pz  Q 2)  ~ oC  • A1 
that  is 

E [x(t  + At)  - x(t)/x(t)]  ..  E [ Ax(t)/x(t)l  (2-8) 


Var  x(t  + At)  - x(t)/x 


:t)/x(t)] 


(2-8) 


In  general  the  parameters  <x  and  J2>  can  be  dependent  on  the  state  x(t) 
We  can  consider  as  well  a multidimensional  diffusion  process  x(t) 
with  vector  mean  per  unit  time  ^3  and  covariance  matrix  per  unit  time 
A =[c<ij]  • ^ this  case  the  diffusion  equation  relates  the  derivatives 
of  the  multidimensional  p,d,f .p(x;t/xQ)  and  the  expression  (2-7)  becomes 

dPUit/xQ) 


dp(x;t/x0)  ^ i £)  pCxst/xQ) 

St  = ,4*-,  -4  2 <Xij 


i=l  j=l 


where  m is  the  dimension  of  the  process  and 


The  probability  of  each  process  i (i  = 1,2,,..  m)  jumping  upwards  pA 
and  downwards  q^  have  to  satisfy  now  the  conditions  (2-6)  and  (2-7)  for 
each  process  x^t)  to  be  considered  as  diffusion,  and  similarly  for  each 
individual  process  it  must  be  fat  = Ki  0 where  the  constant  Ki  are  in 


principle  different 


In  the  computer-network  system  we  are  interested  the  state  of  each 
process  represents  the  total  number  of  messages  that  are  waiting  to  be 
transmitted  at  an  specific  queue.  For  each  queue  i there  is  a lower 


reflecting  barrier  at  x.  = 0 because  the  number  of  messages  in  a queue 


cannot  be  negative.  If  there  is  no  restriction  on  the  queue  length,  then 


there  is  no  upper  barrier.  Practically  the  size  of  the  queues  are  limited 


by  the  length  of  the  buffers  where  the  messages  are  stored.  Therefore  an 


upper  barrier  is  to  be  assumed  too  which  if  reached  indicates  that  the 


buffer  is  full 
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- SOLUTION  OF  THE  DIFFUSION  EQUATION 


The  solution  of  (2-5)  or  (2-10)  depends  upon  the  conditions  imposed 
on  x(t).  If  x(t)  is  allowed  to  take  any  value:  - OO  < x(t) < +°°  the 

joint  p.d.f.  (p(x  ;t /xq)  solution  of  the  diffusion  equation  is  the 
corresponding  to  a multidimensional  Wiener  process  with  mean  fl  t and 
covariance  matrix  At: 


p(x  ; t/xo)  = 


>[-  7 <£  “ *0  - 


£t)T  (At)*1  ~ *0  " .£.*■) 


(3-D 


(2  ti)d 


(Taking  in  (3-1)  the  derivates  b/  b / bx ^ bx  and  b/  b^>  It  can 

be  easily  seen  that  (3-1)  satisfies  expression  (2-10). 

Observe  that  (3-1)  has  no  steady- state  solution  when  t — »oo. 

If  one  reflecting  barrier  is  considered,  say  at  x = 0,  the  solution 
of  the  scalar  diffusion  equation  (2-5)  with  initial  condition  p(x;0/x q)  = 
= 6 (x  - Xq)  can  be  found  by  using  the  method  of  images  ^2hjand  it  is  ^j: 


p(x  ; t/xQ)  = 


'2  nett 


oxp  - 


x - x0 


-H 


♦ exp  - 


2 \/3 


C0  j * 


x + x0  — / 3 t 


X ♦ Xq  ♦ yfl  t 


2 1/3  I 


. ILfiix 


(3-2) 


r 
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where 


$(z) 


x /V* 

“ * 


du 


The  first  term  of  (3-2)  corresponds  to  the  transient  period  and  the 
second  one  is  the  steady-state  tern.  By  inspection  of  (3-2)  it  is  easy 
to  see  that  when  t — - • oo  the  first  term  of  (3-2)  vanishes  and  the  second 
one  becomes 

[ 0 j > 0 

lim  p(x,-  t/xo)  = p(x)  = / (3-3) 

t—  OO  t 


2lifll 


exp 


! y3  < o 


for  x ^ 0 

that  is  an  steady-state  solution  exist  for  negative  drift  which  physically 
means  that  the  service  process  has  to  be  faster  than  the  arrival  process 
so  that  the  length  of  the  queue  does  not  become  infinite. 

If  two  barriers  are  considered  at  x = 0 and  x = a > 0 for  example 
then  the  equation  (2-5)  for  the  scalar  diffusion  with  initial  condition 
p(x{  0/xq)  = (x  - Xq)  and  boundaries  O^x(t)  ^ a,can  be  solved  by 
the  separation  of  variables  method  and  the  solution  is»  ^25 J 


p(x»t/x0)- 


expl-^-  x 
2ot  H2ot 

+ expf-^ftl 

,xp^_aj.  1 

+ pl  8^r  ) 

(3-*0 


OO 


• -‘H  'xp  (~ A"  * t}  -zr;  (p  /«o; 


for  O^x^a;  t > 0 


and  X = n ~ * n = 0,  ♦ 1,  +2, 


^(x)  = cos  Xnx  ♦ -£l£  sin  \x 

An 

Regardless  of  the  sign  of  fi  there  is  * steady-state  solution  when  t -» 
This  distribution  denoted  by 

p(x)  = lim  p(x>  t/xo) 
t-*00 

can  be  obtained  by  taking  limits  in  (3-*0 


4r  l &*) 

•)* 1 


0<x^  a ; 


(3-5) 


For  the  multidimensional  process,  define  a vector 


X = * A'  a 


(3-6) 


and  then  the  steady-state  distribution  of  the  process  x(t)  can  be  obtained 
by  equating  to  zero  the  right  hand  side  of  (2  10), 

This  gives  [lbj 


p(x)  = lim  p(£jt/x0)  si  I P^i) 
t-*oo  1=1 


(3-7a) 


where 


Pi(*)  = 


l 0 J^x.^  ^ aA 


(3-7b) 


4.-  DIFFUSION  MODEL.  FOR  MESSAGE  ROUTING  IN  A COMPUTER  NETWORK 


4,1,-  The  general  Modal 

Let  us  consider  a general  network  of  N computer  centers  (nodes). 

The  same  notation  as  in  ^23 j will  be  followed.  Each  node  can  be  connected 
to  any  of  the  remaining  (N-l)  nodes  in  both  directions.  We  have  then  a 
possible  total  number  of  communication  lines  N(N-l), 

The  nodes  will  be  represented  by  letters  1 (i»l,2,  . ,,,N)  and  the 
branches  by  pairs  (i»j)  (i,J  * 1,2,  ...  N > i + j).  Call 
I(i)  the  set  of  branches  entering  node  i 

D(i)  the  set  of  branches  coming  out  from  node  i 

At  each  node  there  can  be  a maximun  of  (N-l)  queues  where  messages 

«■» 

with  destination  any  of  the  other  remaining  nodes  wait  to  be  transmitted. 
Clearly  the  total  number  of  queues  in  the  whole  system  M is  such  that 
M <N(N-1). 

The  queueing  processes  are  of  discrete  nature  themselves  as  was 
pointed  out  in  a preceding  section.  The  diffusion  model  that  is  stablished 
here  makes  the  approximation  of  considering  them  as  continuous  processes. 

In  order  to  do  this,  the  messages  (that  in  principle  have  different  lengths) 
are  assumed  to  be  divided  in  small  packets  of  duration  fat  units  of  time. 

The  time  will  be  assumed  divided  in  intervals  (t,  t +Al)  small  enough 
so  that  the  following  events  will  occur i 

*ij(t)  » Prob.  that  a message  of  length  fot  with  final  destination  node 
j arrives  at  node  i from  outside  the  network. 


19 


1 - * Prob  that  no  message  of  length  At  with  final  destination  j 

arrives  at  node  i from  outside  the  network 


i,j  * 1,  2,  ...  N j i 4 i 


Therefore  during  (t,  t At)  only  these  former  events  can  occur.  The 

probability  that  more  than  one  message  comes  is  zero. 

u^j(t)  a Prob.  that  a message  of  length  At  with  final  destination  k is 
transmitted  from  node  i to  node  j. 

1 - Uij(t)  a Prob.  that  no  message  of  length  At  with  final  destination  k 
is  transmitted  from  node  i to  node  j 

i,J  a 1,2,  ...  N i i + J 

c. ■ a Prob,  that  no  message  of  length  fat  is  transmitted  succesfully  from 
J node  i to  node  j. 


ij  = 1,2,  ...  N i i t j 

Observe  that  c^  corresponds  to  the  capacity  of  the  link  (i,j) 
expressed  in  terms  of  probabilities  rather  than  in  traffic  units. 

In  Fig  4,1  a diagram  of  such  a general  network  is  depicted. 

The  capacities  are  fixed  for  each  channel  (i.j).  The  incoming 
traffic  probabilities  «ij(t)  are  quantities  that  depend  on  the  amount  of 
users'  demand  at  the  specific  time  t.  We  shall  consider  this  demand  rate 
to  be  stationary  so  that  it  will  not  be  dependent  on  time  but  a constant 

*ir 


The  outcoming  traffic  probabilities  u^t)  are  the  quantities  we 
want  to  find  according  to  the  input  traffic  and  the  network  fixed  capacities 
so  that  the  system  performance  is  satisfied,  according  to  some  criteria 
as  we  shall  see  later.  For  the  same  reason  as  a^j(t),  the  probabilities 
u^(t)  will  be  independent  of  time. 

From  the  previous  definitions,  notice  that  each  channel  (i,j)  can 


Fig  4.1 j General  configuration  of  a computer-communication 
network. 

handle  messages  with  different  final  destination.  Thus  the  total  traffic 
the  channel  (i,j)  carries  is  composed  of  all  the  messages  going  during 
(t,t  ♦ At)  from  node  i to  node  j whatever  the  final  destination  is.  In 
order  for  the  transmission  to  be  succesful  this  traffic  has  to  be  less 
than  or  equal  to  the  capacity  c^.,  that  is« 
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and  clearly  ^ 0 f V (i,j)  (4-lb) 

The  constraint  (4-la)  is  necessary  to  have  an  errorless  transmission. 

Now  consider  the  queueing  process  representing  the  number  of  messages 
nij(t)  that  are  waiting  at  node  i to  be  transmitted  to  node  j at  the  time 
t.  If  finite  capacities  are  assumed  for  the  buffers,  that  is  is  the 
maximun  number  of  messages  that  can  be  stored  at  i to  be  transmitted  to  j, 
then  the  ratio 

x..(t)  = -ni.j(t)  (4-2) 

J Nij 

represents  the  normalized  queueing  process  so  that 

0 ^ *ij(t)  ^ 1 s i.j  = 1,2,  ...  N j i 4 3 

(4-3) 

When  the  message  lengths  fat  become  very  small  it  is  clear  that 
x^j(t),  representing  the  amount  of  messages  filling  the  buffer  with  respect 
to  its  total  capacity,  becomes  of  continuous  nature  and  can  be  approximated 
by  a diffusion  process  with  two  reflecting  barriers  at  x = 0 and  x = 1 as 
indicated  in  (4-3).  The  lower  barrier  represents  the  queue  completely 
empty  and  the  upper  one  representing  the  queue  full. 

At  each  node  we  can  have  at  most  N - 1 queues  and  in  the  whole  system 
the  maximun  number  of  queues  is  N(N-l).  This  can  be  visualized  in  Fig  4.2 
for  N * 3 in  which  node  1 has  been  magnified  to  indicate  all  the  queueing 
processes  that  take  place. 

The  switch  S represents  that  the  channel  c^2  can  handle  messages 

from  x12(t)  with  probability  u^2  *nd  messages  from  x^t)  with  probability 

3 2 3 

u^2  such  that  u^2  ♦ u^2  ^ c^2. 

Similarly  for  the  other  switches:  messages  travel  from  node  2 to  node 
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3 

1 with  probability  uj^  entering  queue  x^(t)  end  waiting  to  be  transmitted 
to  its  final  destination  node  3. 

4.2,-  Diffusion  approximation  for  the  routing  model 

We  saw  in  section  3 the  steady-state  solution  of  the  M-dimensional 
diffusion  equation  (2-12), 

The  case  we  are  dealing  with  is  M ^N(N-l)  and  the  barriers  for  all 
queues  are  0 and  1, 

The  joint  p.d.f.  of  the  system  is  given  by  (3-7)  with  a^  = 1 for 
all  i. 

It  was  established  in  section  1,3  that  the  performance  criteria 
will  be  to  minimize  the  overall  delay  messages  experience  (on  the  average) 
when  they  are  transmitted  from  their  origin  to  their  final  destination. 

An  equivalent  condition  is  to  minimize  the  average  queue  size  of  the 
whole  system.  To  see  this,  consider  one  queue  n^(t).  If  we  call  A^j(t) 
the  number  of  arrivals  at  node  i with  destination  j during  (0,t)  and 
D^(t)  the  number  of  departures  from  this  queue  in  (0,t)  then 

nij(t)  = k±.(t)  - D (t)  (4-3) 

represents  the  total  number  of  messages  waiting  at  that  queue  at  time  t. 

The  quantity  A 

nij(  £ ) dt  (4-4) 

is  the  total  time  all  messages  have  spent  in  that  queue  during  (0,t). 

The  average  delay  per  message  at  that  queue  will  bet 
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[t«] 


Ode 


<4- 5 ) 


Aij(t) 


and  the  average  number  of  messages  waiting  at  the  queues 

■t 


£ 


[ nij(t)  ] 


/ 


( X>  )de 


(4-6) 


Therefore  from  (4-5)  and  (4-6)  we  see  that  minimising  the  average 
delay  is  equivalent  to  minimising  the  average  queue  length  or  normalising 
aoording  to  (4-2),  minimising  £ [xij(^)  ] • 

In  the  discussion  of  section  3 about  the  diffusion  process  we 
implicitely  assumed  that  there  were  no  idle  periods,  that  is  when  the 
process  reaches  the  lower  barrier  it  does  not  stay  on  there  but  jumps 
up.  This  has  not  to  be  the  case  in  general  because  with  some  probability 
there  will  be  certain  idle  periods  in  which  the  queue  will  be  empty.  This 
probability  of  idle  periods  can  be  expressed  in  terms  of  the  utilization 
factor  ^12 J which  is  defined  as  the  ratio  of  the  rate  at  which  the  jobs 
enter  the  system  to  the  maximun  rate  (capacity)  at  which  the  system  can 
perform  this  work.  Calling  this  factor  f(<l)  the  probability  of  idle 
period  will  be  1 - J>. 

Therefore  the  p.d.f,  (3- 7b)  shoud  be  modified  to  include  the 
effect  of  idle  periods  and  this  can  be  taken  into  account  by  splitting 
the  p.d.f.  into  two  parts.  One  representing  the  probability  of  empty 
queue  (an  impulse  of  weight  1-p)  and  the  other  representing  the  continuous 


distribution  when  the  queue  is  not  empty 

X Jix 

Pi(x)  * (1  - J(X)  ♦ — ; 0 < x $ 1 


(4-7) 


J 
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which  is  represented  in  Fig  4,3, 


Fig,  4.3  Steady-State  p.d.f.  of  a diffusion  process 
The  expected  queue  length  for  the  i-th  queue  is  calculated  from  (4-7) 

r1 

E(*i)  = I x4  pi(xi)  dxi  = 

Jo 

In  Fig.  4,3  the  expression  (4-8)  is  represented.  As  it  cn  be  seen 
0 <£(xi)  < j>  , In  the  same  figure  it  is  represented  the  function 
- 1/  ( ^<0)  which  would  be  the  mean  value  in  the  case  of  no  upper 

barrier.  We  can  see  that  for  values  of  H ^ less  than  —3  both  curves 
are  very  close.  The  presence  of  the  upper  barrier  prevents 
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the  queue  length  from  Increasing  without  limit  and  therefore  it  does  not 
become  unbounded  at  s 0, 

The  significance  of  the  parameters  5^  can  be  seen  from  Fig.  4.4« 
^<0  means  the  queue  is  on  the  average  less  than  0.5  f ^ full  and 
> 0 more  than  0.5  full. 

The  overall  mean  value  is  given  by 


• t) 


(*♦-9) 


and  this  is  to  be  minimized  over  some  region  of  the  M -space  determined 
from  the  constraints  of  the  problem  as  we  shall  see  in  section  4,5, 


4,3,-  Calculation  of  the  diffusion  parameters 

We  want  to  find  the  components  of  the  vector  mean  per  unit  time 
and  the  elements  of  the  covariance  matrix  per  unit  time  J\_  defined  in 
section  2 (Sqs,  (2-11)  and  (2-12)), 

Consistent  with  the  notation  in  section  4.1  let  us  redefine  J3_  and 


Ai  = lim 


E x,  .(t  + At)  - x.  .(t) 


At-o 


— lim 

At-0 


E Axii(t) 


x(t) 


x(t) 


(^-10) 


(**-11) 


lim 


At  — 0 


Cov  |^A*ij(t)  Axki(t) 
_ 


x(t) 


(i  j),  ( kl)  = 1,  2,  M j M ^ N(N-l) 


Whan  At  tends  to  zero  the  jumps  at  each  queue  Q . tend  to  zero  too 

A J 


according  to 


At  = K ( O^)2  , V(ij) 


(**-12) 


where  the  constants  account  for  the  possible  different  buffer  lengths. 


We  are  now  going  to  calculate  the  parameters  J3±y  °((ij)y(lcl)  terms 
of  the  probabilities  defined  in  section  4,1, 


Fig  4.5i  Arrival  and  departure  processes  in  a queue 


Consider  the  queue  x^.(t)  (Fig.  4,5) 


.1 


u 

* I 


I 

F 
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then 


Ax  (t)  = JLLi(t)  ♦ * Vni(t)  - 

ij  ^ m£  I(i)  n£  D(i) 

» 4 j 


(4-13) 


where  for 
variables 

all  t.JH^t), 
that  can  take 

, V^t),  V^,t)  are 
the  following  values: 

J4j(t) 

= 0 
ij 

with  probability  a^ 

= 0 

with  probability  (1  - 

*L(t) 

•o 

cdh 

ii 

with  probability 

= 0 

with  probability  C - 

vL«*> 

■ ei: 

j 

with  probability  u^ 

= 0 

with  probability  (1  - 

ij' 


!J  : 

in 


according  to  what  was  established  in  section  4,1 
Calculation  of  the  incremental  wean  coefficients 


The  mean  value  of  ^x^(t)  is  from  (4-14)  - (4-l6  ) 


E[^ij(t)  | i(t)]  = B[A*i5(t)]  = 


- 0io 


y ) 

i ®i  i ^ / -i  ^ ^ ^in 

\ ij  m £ I(i)  «i  n€  D(i)  in 


m 


j 


(4-14) 


(4-15) 


(4-16) 


’ J 


i 

■ i 


(4-17) 
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Substituting  0^  * and  taking  limits  in  (2-13)  when 


At  -•  0 , we  obtain 


j3*  j = lim 

^ At— o 


[Axij(t)] 


y , y j 

♦ Z-  “la  - Z-  ui 

iCIU)  1 n£D(i) 


(4-18 ) 


lim 

At  — 0 


i£I(i) 

3.  

1/2 

K..  . At 


for  all  pairs  (ij)  * 1,2,  ...  M | M ^ N(N-l) 


Calculation  of  the  covariance  matrix  elements 


— Diagonal  elements  s from  (4-13).  since  Ax^(t)  is  a sum  of  independent 
random  variables  we  have: 


V.r  [A*y<t>]  * V.r[^y(t)]  ♦ Y. 


Var[yJ(t)K 

m€I(i)  mi  J 

tn^j 


♦ X!  v»r[v^,(t)] 


(4-19) 


n«D(i) 


and  substituting  the  value  of  the  variance  corresponding  to  a Bernoulli 
random  variable  we  obtain: 


Vmr  AV‘)  - ey  sija-1ij)\{%)u>i(1-u.1)  * 


y , . 

* n<Vi)"^1-US 


(4-20) 


3: 


Off-diagonal  elements*  Consider  two  different  queues  x^(t)  and 
(t)  (Fig.  4.6) 


Xij(t) 


Fig.  4.6:  Arrival  and  departure  processes  involved  in 
two  queues 

.(t)  = Rii(t)  ♦ XI  V*(t>  - I vinU) 

iJ  r mel(i)  ml  n € D(i) 


m 4 j 


v>- 

k^l  p 1 


p€  MK 

P 4 1 


Since  jx^t)  and  j^ki^  are  indePendent* 

Cov  [/H-U(t)  >*kl(t)]*  COV  ^ij(°  Vpk(t)l  * COV  [V»i(t)/ikl(t>l 


co,  [Axlj(t)  AV(t)]  - m<J)  pI)V>^0 


^ j P ^ ; 
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m 4 j 


♦ A Z.  vf(t)vj(t)  = e a, 

n £ D^i)  q€D(k)  *"  kq  iJ  kl 


n£D(i)  pC  I(k) 
P^l 


in'1'  Ypk< 


I y y>i 

|.€K1)  P€«k)'lmi”pk  ’ 
'■m  ^ j P 4 1 


y y , i y y i i 

mcfe  q£  D(k)  ni  kq  n«D(i)p€l(k)  in  Pk 

* ^ j P ^ 1 


y y a i ) 


(“-21) 


Consider  each  term  in  (4-21)  separately  (see  Fig.  4.7  as  an  example 


for  N = 4,  M = N(N  - 1)  * 12) 


1)  m € I(  i) 

m 4 j 


P€l(k) 

P ^ 1 


*pk«->  = 


Umi  > 1 "•i  * P'  k 


o } m,i  = p,k  and  j^l  (b) 

cannot  be  that?  m,i  = p,k  and  j = 1 (c) 


The  above  expressions  are  obtained  because t 


(a)  V^U)  and  are  independent  (queues  at  the  same  different  nodes) 


(b)  Messages  with  different  destination  (j  4 1)  cannot  go  over  the  same 
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channel  (m,i  = p,k)  at  the  same  time  t (see  Fig  **.7,  both  queues 
are  in  the  same  node  i = k) 

(c)  This  case  corresponds  to  the  Var£v^(t)j  and  was  calculated 
previously  in  (4-19).  Observe  that  the  terms  corresponding  to 
(4 -22a)  when  substracting  the  products  of  the  means  to  obtain  the 
covariance , will  yield 


V>>  vjku>  - v>)  v^t)  = ^ • »Jk  = 


and  the  terms  corresponding  to  (4-22b)  will  yield 


V>>  vjk(t)  - Vnl(t)  v^(t)  = o.ui,  ujk 


2)  «{I(i) 

m 4 j 


q€D(k) 


j 1 , / . 

u u,  j m,i  t k,q 

mi  kq 


- 0 


j m,i  = k,q  and  j 4 1 (b) 
; m,i  = k,q  and  j = 1 (c) 


(4-23) 


The  equations  (4-23)  are  obtained  because: 
(a)  and  (b)  the  same  reason  as  in  (4-22) 


(c)  it  is  the  same  random  variable  V^t)  corresponding  to  two  different 
queues  x^t)  and  x^t)  which  are  in  nodes  i and  k respectively.  See 
for  example  Fig  4.7:  Consider  the  processes  x12(t)  and  x^(t)  belonFin? 
to  nodes  1 and  3 respectively  ( i=l , k=3 , j=l=2) 


When  m*k=3  and  q=i=l  the  term 


V31U)  V^Ct)  * [^31(t)l  * U31 


as  indicated  by  (4-23c) 

The  term  corresponding  to  (4-23c)  in  the  covariance  expression  will 

be 


[v>>]2  - Wi(«]2  - »ii  - ■ "ii (i  - "»i> 

3)  n€D(i)  ; p€l(k) 

P 4 1 

This  case  is  exactly  like  2).  Just  interchange  this  subscripts 
i — -k,  m— »p,  q^-»n,  j — »1 


4)  n «D(i)  ,•  q€  D(k) 

This  case  is  similar  to  1),  The  only  difference  is  that  it  takes  the 
processes  coming  out  from  node  i and  node  k whereas  in  1)  we  had  the 
processes  entering  nodes  i an  k,  Therefore  the  corresponding  expression 
is 

f uin  \n  5 i>n  ^ k,q  * U) 


yj  (t)  yj  (t) 

in  kq 


< 0 5 i.n  = k,q  and  j ^ 1 (b) 

cannot  be  that  i,n  = k,q  and  j = 1 (c) 

k 

(4-24) 


According  to  this  we  can  have  several  cases: 

A)  Both  queues  are  in  the  same  node  i = k.  In  this  case  only  the  first 
and  fourth  tern  of  (4-20)  enter  in  the  covariance  (relating  the  inputs 
and  outputs  respectively): 


Cov  [Axw(t)  A^(t)] ' - „ Ai,  u»i  u"i  - M)  **  '* 

n/i 

(N-3)terms  (N-l)  terms 

(4-25) 

B)  Both  queues  are  m different  nodes  i ^ k.  In  this  case  the  2nd.  and 
3rd.  term  of  (4-20)  appear.  There  are  two  possibilities: 

B-l)  Both  queues  have  the  same  destination  i j » 1 

c»»  [&*„«■>  A\j(t)]  - - >4  <1  - 4>  ’ 4 (1  * V1 

irfkrfj  (4-26) 

B-2)  The  queues  have  different  destinations:  j ^ 1 

Coy  [A^O  A^t)]  >44’  “ki  "kl 

i^j  » ktfL  (4-27) 

but  observe  that  if  k 4 j 

Cov  [A*i:j(0  Axj1(t)]  * uij  (because  = 0) 

and  if  i ■ 1 

Cov  £ Ax^U)]  = u^i  u^  (because  u^  = 0) 

4,h  Conditions  for  the  diffusion  to  be  valid 

Going  back  to  the  expression  (4-18),  if  has  to  have  a finite 

value  it  is  necessary  that  the  numerator  of  that  expression  tends  to 

, a^1/2 
zero  as  ( Aw 


Recall  what  was  established  in  section  2.2.  concerning  to  the 
conditions  for  diffusion:  for  the  variance  and  mean  per  unit  time  to 
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make  sense  the  probabilitites  of  jumping  upwards  and  downwards  have  to 

be  "nearly"  the  same,  the  difference  being  a quantity  depending  on 

l/2 

(At)  and  therefore  this  difference  decreases  proportionally  to 

l/2 

(At)  when  At  tends  to  zero.  This  is  reflected  by  the  expressions 
(2-6)  and  (2-7). 

Therefore  let  us  assume  that  the  probabilities  a^j  and  u^j  are  of 

the  form  of  (2-6)  and  (2-7)  that  is  a constant  term  plus  another 

l/2 

depending  on  ( At)  that  is: 


*«  * Au  * ?13^ 


(4-28) 


“13  = * yij  ^ 


(4-29) 


The  channel  capacities  which  are  related  with  the  service  process 

will  be  considered  of  the  same  form  too,  that  is  a fixed  term  plus  another 

1/2 

varying  with  (At)  as  shown: 


eij  * Cij  * 


(4-30) 


which  means  that  the  capacity  of  channel  i - j is  variable  about  a fixed 

1/2 

value  in  a quantity  proportional  to  (At)  1 

Then  the  conditions  that  have  to  be  satisfied  for  the  diffusion 
property,  are  obtained  by  plugging  (4-28),  (4-29)  and  (4-30)  in  (4-18). 
Thus  we  obtain: 


m i j 


(4-31) 
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m«IU) 
m 4 j 


J 


n € D(i)  in 


Kij  Aj 


(**-32) 


for  *11  pairs  (i.  j)  = 1,  2,  ...  M i M^N(N  - 1) 

The  constants  are  given  by  the  buffer  size.  From  (**-12)  we  see 
that  K ( 0ij)2  = Kkl(  0kl)2  but  Q±i  = 1/Nij  and  thus  K^/K^  = 

- < Vki’2- 

The  expression  (**-31)  is  related  with  the  deterministic  flow  at 

each  queue  and  simply  states  the  balance  that  has  to  exist  at  each  node 

between  inputs  and  outputs  if  the  traffic  were  deterministic,  whereas 

(**-32)  gives  an  idea  of  the  infinitesimal  variation  during  (t,t  ♦ At) 

since  the  drift  . indicates  de  tendency  of  queue  (ij)  to  increase 
* J 

or  decrease  per  unit  time.  Moreover  from  the  capacity  constraints  (**-l): 


j5  Y.  0* 

i 4 k 


k 

Uij^° 


(**-33) 


y".  £ o 

ij 


(**-3**) 


**.5.-  Optimization  procedure 


In  the  model  we  have  established,  we  have  a network  whose  channels 

c^  are  given  and  have  fixed  capacities.  The  input  traffics  a^  . depend 

on  the  users'  demand  so  that  are  considered  as  fixed  quantities  too. 

The  question  is  to  find  the  best  routing  strategies  within  the  system 

k 

which  are  represented  by  the  probabilities  u^.  defined  in  section  **.l 
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subject  to  the  capacity  constraints  (4-1).  The  quantities  will  be 
called  routing  variables  and  will  have  to  be  chosen  to  minimize  the 
average  queue  length  in  the  system  according  to  the  given  input 
traffic  and  the  fixed  capacitites.  This  is  an  open-loop  type  control 


procedure . 

Note(Fig  4.7)  that  the  maximun  number  of  routing  variables  we  can 
have  per  queue  is  N » 1 so  that  in  the  whole  system  we  can  have  at  most 


M(N  - 1)  control  variables. 

The  expression  of  the  covariance  elements  follow  from  the 
expressions  (4-20),  (4-25),  (4-26),  (4-27)  and  (4-11),  (4-28),  (4-29). 
Thus  we  have 

Variance  elements  (recall  (4-20)) 
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:)  i ^ k ,•  j 4 1 


(recall (4-27)) 


<X 


(ij).(kl)' 


j 1 1 i 

ir  u..  ♦ u ir, 

ik  ik  ki  ki 


(4-38) 


/T 


(Remember  special  cases  of  (4-27)  when  k = j or  i = 1) 

Therefore  the  covariace  per  unit  time  is  a K x M matrix  J\  which 

depends  on  the  M possible  inputs  assumed  to  be  given  and  on  the  L 

control  variables  U*  where  M(N  - 1)  .We  write  A = A(ApU) 

ij 

where  A and  0 are  respectively  M and  L dimensional  vectors. 

Notice  than  the  L routing  variables  U . may  not  be  chosen 
independently,  because  they  have  to  satisfy  the  system  of  equations 
(4-31)  so  that  only  L - M variables  are  independent,  provided  that  they 
satisfy  the  capacity  constraints  (4-33). 

We  want  to  minimize  the  overall  mean  (4-9)  that  is 


M 

min  F(J[_)  = min  £ P** 

all  queues  i=l 


e - 


IT 


(4-39) 


where  are  the  elements  of  the  vector  JS_  defined  as  = 2A  ^ 

The  drift  vector  ^ can  be  expressed  in  terms  of  the  inputs  p^j  and 

the  control  variables  yj.(m€l(i)  ; m 4 j)  and  y^  (n€  D(i)),  From 

in  l in 

(4-32)  and  using  matrix  notation: 


where 


fi  = p + H y 

A c 


(4-40) 


flij 
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for  all  possible  pairs  (i  j)  and  where  H is  a M x L matrix  depending 
on  the  specific  conf iguration  of  the  system  and  whose  elements  can  be 
only  ♦ 1 for  incoming  links,  -1  for  outgoing  links  and  0 when  there  is 
no  conexion 

Then  we  haves  ^ 

j[_  * 2_A"1  jp_  + 2A"1  H Z (4-41) 

Call  for  convenience 

2 p - d (M-dim . vector)  (4-42) 

and 

2 A'1  H = D (XxL  matrix)  (4-43) 

then 

— = d ♦ _D  £ (4—44) 

and  the  problem  is  to  find 

min  F(d  ♦ D jr)  (4-45) 

u 

where  u = U ♦ ^ The  minimization  (4-45)  is  to  be  carried  over 

the  vectors  U and  jr  with  the  constraints  (4-31)  and  (4-33)  on  the  vector 
U and  with  the  constraints  (4-34)  on  the  vector  v. 

The  constraints  the  elements  of  U have  to  satisfy  are  those 
given  by  (4-33)  (capacity  constraints)  and  (4-31)  (flow  balance  at 


each  queue).  In  general  for  given  inputs  A_  and  capacities  C^,  the 
vector  U satisfying  (4-31)  and  (4-33)  will  not  be  unique,  and  for 
different  choices  of  U the  covariance  matrix  will  be  different  and 
so  will  be  the  minimum  of  (4-45).  In  order  to  simplify  the  minimization 

r 

(4-45)  it  will  be  assumed  in  this  thesis  that  J\  is  fixed,  that  is  we 
have  chosen  a vector  U satisfying  the  requirements  of  (4-31)  and 
(4-33)  which  represents  an  equilibrium  situation  for  the  system  and 
we  shall  be  interested  in  how  the  system  will  behave  for  small 


alterations  about  the  equilibrium  situation.  In  particular  we  shall 


seek  how  the  routing  variables  y 


will  vary  so  that  the  overall 


average  queue  length  of  the  system  is  minimum 


With  this  asumption  the  vector  d and  the  matrix  D are  constant 


and  the  minimization  problem  can  be  stated  as  : 


(4-46a) 


subject  to 


y.  . ^ 0 (4-46b) 


The  aim  is  then  to  find  the  optimum  vector  that  satisfies 
the  minimization  (4-46). 


Notice  that  the  function  we  want  to  minimize  es  a sum  of  M 


functions  like  the  one  shown  in  Fig  4.4  which  is  convex  for 


over  the  constrained  region.  The  convexity  property  is  convenient  to 


include  it  when  the  minimum  is  searched  by  numerical  methods  starting 
with  some  initial  guess.  Physically  it  reflects  the  fact  that  the  messages 
arriving  at  the  nodes  do  not  stack  up  at  the  queues  so  that  the  system 
behaves  "nicely"  and  does  not  become  congested. 


5.-  ILLUSTRATIVE  EXAMPLES 


Let  us  now  apply  the  theory  developped  in  the  preceding  sections  to 
some  specific  examples. 

Our  purpose  is  to  minimize  a function  of  L variables  subject  to  some 
constraints  over  a convex  region. 

Because  of  the  exponential  nature  of  the  function  (4-8)  even  with  a 
small  number  of  variables  it  is  not  possible  to  find  analytic  solutions 
and  one  therefore  has  to  use  numerical  procedures  . 

The  minimization  procedure  that  will  be  used  is  based  upon  the  method 
of  Zangwill  ^2?J  which  is  a modification  of  Powell' s algorithm  £isj  , 

Basically  an  initial  point  and  a set  of  L directions  are  chosen. 

Along  each  direction  the  minimum  coordinate  is  found.  In  the  next  step  the 
first  L - 1 directions  are  taken  as  the  L-l  last  directions  in  the  first 
step.  The  L-th  direction  is  taken  as  the  difference  between  the  initial 
point  and  the  minimum  found  in  the  preceding  iteration  and  so  on  until 
convergence  is  reached . 

5.I.-  example  with  two  queues 

In  Fig  5.1  it  is  shown  an  example  of  three  computers!  Yessages  come 
to  nodes  1 and  2 and  have  to  be  transmitted  to  node  3 either  directly  or 
via  the  indirect  path.  When  messages  get  to  computer  3 they  leave  the 
system.  No  messages  enter  at  3. 

According  to  what  was  stated  in  section  4,1  the  time  is  divided  in 


small  intervals  (t,t  ♦ /^t)  and  during  this  time  we  call  a^  snd  a^  the 


Fig  5.1.-  Network  of  three  nodes:  two  sources  and  one 
destination 

probability  that  a message  enter  node  1 and  node  2 respectively. 

The  traffic  a^  can  g°  directly  through  the  channel  c-^  or  through 

c, „ and  c00.  Similarly  for  the  traffic  a0^. 
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As  it  can  be  seen  in  Fig  5.2  there  are  only  two  queues  in  the  system 
one  x^-j(t)  corresponding  to  node  1 and  the  other  x2^(t)  corresponding  to 
node  2.  There  are  no  queues  at  node  3 because  this  is  only  destination 
node.  Similarly  there  are  no  queues  x^2(t)  at  node  1 and  x,,^(t)  n0^e 
2 because  neither  of  those  nodes  are  final  destination  but  traffic  source 


node  5 


mode  l 


NODE  2 


-Mig.  5.2.  Network  of  three  nodes.  Queues  detail 


or  intermediate  destination  nodes. 

The  capacity  constraints  are 

“13  < C13  ' U23<e23'  U12«°?2'  u21«  C21 

The  capacities  are  assumed  to  he  of  the  form  ( tu-30 ) 


WB 


47 


C12 

SB 

C12 

+ 

q!2 

(5-2) 

C21 

SB 

°21 

q21 

The  external  and 

internal  inputs 

and 

outputs  are  of 

the  form  of 

(4-28)  and  (4-29) 

*13 

s 

*13 

♦ 

p13 

\fKt 

a23 

s 

A23 

♦ 

p23 

/At 

u13 

s 

U13 

+ 

73 

713 

/At 

(5-3) 

u?3 

= 

u23 

♦ 

y^3 

\TTt 

u12 

= 

U12 

♦ 

y?2 

/a7 

4 

= 

U21 

♦ 

y21 

/At 

The  proportionality  constants  and 

which  relate  the  time 

interval  At  and  the  queue 

step 

sizes 

S13 

and  Q will 

be  taken  as 

Then  we  have  At  = 0^  = 0^  that  is  the  steP  size  in  both  3ueues  is  the 
same  and  tends  to  zero  as  ( At)^"^.  This  makes  sense  in  the  case  that  both 
buffers  have  the  same  capacity  and  it  will  be  assumed  so. 

The  expressions  for  the  means  per  unit  time  are  from  (4-32) 


^13  * 

p13 

♦ y3  - 

y21 

- y3 
y12 

3 

3 

3 

^23  = 

p23 

+ y12  - 

y23 

* y21 

(5-4) 


and  the  flow  equations  from  (*+-31) 


*13  ♦ "L  - ^3  ' iz  - ° 

(5-5) 

*23  + °12  " °23  “ °21  * •* 0 ] 

The  elements  of  the  covariance  matrix  are i From  (4-35) 

*(13), (13)  ” °*ll  = a13^  “ A13>  * U21  (1  - u2i)  ♦ Ui3(l  - u^3)  ♦ 

♦ uj2(l  - \i\2)  (5-6) 


*(23), (27)  = <*22  * h.^1  - *23}  + U12<X  * U12>  + U23d  - 0^)  ♦ 


* U21^‘U21> 


(5-7) 


From  (4-37) 


*(13), (23)  = <*12  = ” U12(1  " U12)  - u2l(1  “ u2l) 
The  expression  we  want  to  minimize  is  (4-39) 

/ ^ n \ / 21 


. ,23  . i 


1 


where 


— = ( ^13  • ^23 )T 


and  such  that  jf  = 2 A"1  £ = v jfl 

*nd  £=<^13’A>3)T 


(5-8) 


(5-9) 


(5-10) 


(5-11) 


(5-12) 


*11  <*i 


•*12  <*22 


We  obtain 


where 


Vu  = 


VU  V12 


V.„  V 
12  22 


°fll  *22  '*12 


(5-1*0 


(5-15) 


V22  = 


^11  *22  **  *12 


(5-16) 


*11  *22  ” *12 


(5-17) 


Observe  from  (5-6).  (5-7)  and  (5-3)  that  Vu>  and  are 

non-negative  and  that  ^^12  an<^  ^22  ^ ^12" 

Notice  that  (5-*0  can  be  rearranged  ess 


A3  ’ <P13  - ' (P*  ' ^ I (5_18) 

*23  * (P23  - y23>  - (y312  ■ ^ 

that  X 4S  wel1  as  £ are  only  dePendent  on  thrae  variables  rather  than 

jr»  they  are  3 . J 3 

y^3  . 723  and  ^12  " *21 


four  1 they  are 


Call  for  convenience 


<*1  * p13 


(3-19) 


I ,.4'  ■ 1 


50 


62  * P23 

- 

*0 

(5-20) 

* - *12 

- 

*21 

(5-21) 

*13  * 

<*1 

- Z 

(5-22) 

^23  * 

*2 

■¥  l 

Therefore  from  (5-11) 

*ij ' vu  *13  * vi2  *23  • vn  <*i ♦ vi2  - (vn  - V 1 l5-23) 

*23  * *12  *13  + *22  *23  * *12  * v22  *2  + (*22  “ *12 ) * (5-21*) 


The  utilization  factors  ares 


(5-25) 


/2  3 


(5-26) 


Minimizing  (5-9)  requires  arx*  ^3  as  ne2atlve  as  possible 

(Fig  4,4.)  Therefore  from  (5-23)  and  (5-2*0  since  the  coefieients  of  6^ 

and  6 are  non  negative.  and  <S  must  be  as  small  as  possible  or 
2 1 2 

from  (5-19)  and  (5-20)  y^  and  y?  must  have  the  maximun  value  which 
is  the  corresponding  capacity,  that  isi  y^  = (5-27) 


(5-28) 


as  we  could  have  expected  from  Fig  5.2.  because  there  is  no  reason 
not  using  the  channels  and  ^23  capacity. 

Then  the  expression  (5-9)  is  only  a function  of  the  variable  z 
= y^2  " y?i  is  bounded  by  the  capacitites  q12  and  921S 

- q2l  < a ^ 912  {5-29) 

Let  us  take  some  values  to  illustrate  the  example.  Assume: 


A = 

13 

0.8 

l ? = 0.6 

13 

C13  ' 

0.75 

A23  = 

0.4 

u h - °-6 

C23  = 

0.75 

U12  ' °'2 

C12  = 

0.75 

“n  - 0 

C21  = 

0.75 

which  satisfy  the  flow  equations  (5-1*0  and  (5-15)  and  the  capacity 
constraints  0 ^ U ^ ( V(ij). 

The  covariance  elements  have  the  value 


o^L1  = 0.56 

• 

* 

°^2 

0.64  ; 

<\2  = -0.16 

and 

Vn  = 3.8462 

1 

V22  = 

3.3654  l 

v12  = 0.9616 

the  utilization 

factors  ^13 

= 0.53  , 

/23  " °-W 

then  if  = 3.8462  ♦ 0,9616  <5 ^ - 2.8846  z (5-30) 

y23  = 0.9616  61  ♦ 3.3654  62  ♦ 2.4038  z 

bearing  in  mind  that  6^  - - q13  and  - p2^  - q2^  • 


(5-3D 


li'fl 


Several  cases  are  shown  in  Fig  5*3  to  Fig  5.8. 
Consider  first  Fig  5.3*  for  which  we  have  chosen » 


p13  * P23  * 0 ' q23  “ q12  = q21  = 1 

and  q,  _ varies  between  0 and  1,  For  q „ = 1 the  optimum  value  of 
13  13 

z = - y - 0.2380  and  the  value  of  Fmin  = 0.1918. 

As  q^  decreases  ( 6^  increases) .both  Xjj  and  increase  but  the 

effect  is  more  remarkable  on  because  (Se®  expressions  (5-37) 

(5-39)  and  (5-4^0,  (5-^*5)*  In  order  to  have  this  increase  as  small  as 
possible,  t will  increase  because  its  coefieient  in  the  expression,  for 
I*  negative.  This  is  what  can  be  seen  in  Fig  5.3  as  q^  decreases. 
This  physically  means  that  when  the  capacity  of  the  link  connecting  nodes 
1 and  3 decreases,  more  messages  tend  to  be  sent  via  node  2 to  partially 
compensate  the  capacity  loss.  As  a consequence  of  the  overall  capacity 
reduction  the  overall  mean  value  increases. 


Fig  5*4  » 

P13  = P23  = 0 ! q13  = q12  = q2l  = 1 

and  now  it  is  q2^  what  varies.  By  a similar  argument  we  can  see  that 

when  q?T  decreases  increases  and  and  Jf  increase  too  although 

the  latter  more.  Therefore  z has  to  decrease  to  compensate  for,  that 

is  less  messages  travel  from  node  1 to  node  2. 

We  can  observe  that  in  both  cases  (Figs.  5*3  end  5**0  the  overall 
mean  has  the  same  value.  The  reason  for  this  can  be  drawn  from  equations 
(5-23)  and  (5-24).  In  the  case  of  Fig  5*3  6 ^ - -1  and  = 6 varying 
between  -1  and  0.  In  the  case  of  Fig  5*^  = -1  and  =&  varying 

between  -1  and  0.  Then 


Routing  variables  and  F in  terms  of  q 


w13  ¥llw 


12  ‘ vvll 


’12 


Fig  5.3 


^23"  V12  " V22  + ^V22  * V12^  z' 


I 


fir  -vn  * v!2rf  -<vn  - V *" 

t zf  -V12  * v22rf  * (v22  - V *' 


Fig  5.^ 


From  this  equations  we  can  see  that  whenever  i'  - 
|'3  = ”3  and  ?23  = J 23  so  that  ^ overa11  nean 


z"  = 1 + ^ then 
value  is  the  same. 


Fig  5.5«  Now 

F>i3  = P23  " ® ’ ^13  “ ^23  = q21  = ^ 

and  q varies  between  1 and  0,  For  q._  = 1,  z — 0,2380  so  that  there  is 
12 

no  effect  ehen  decreasing  q until  it  reaches  the  value  0,238.  From 
this  point  on  the  value  of  z = q^« 

Therefore  the  effect  over  the  overall  mean  takes  place  only  when 
z $ 0.2380.  The  reason  for  this  is  that  when  z decreases  in  (5-23)  0-jj 
increases  and  in  (5-24)  J decreases.  Therefore  the  change  in  the 
overall  mean  is  less. 

Fig  5.6. 1 Decreasing  q21  has  no  effect  because  this  channel  was  not 
used.  The  overall  mean  does  not  change  either. 

Fig  5.7»  Now  all  = 1,  p^  = 0 and  p13  increases.  The  effect  of  p13 
increasing  from  0 to  1 is  the  same  as  ql3  decreasing  from  1 to  0 in 
Fig  5.3  because  in  both  cases  <5  increases  from  1 to  0,  At  some  point 
z reaches  its  maximum  value  1 and  cannot  increase  any  more.  The  overall 


Fig.  5.6.  Example  5.1.  Routing  variables  and  F^n  in  terms  of  q 
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value  increases  then  faster. 

Fig.  5.8.-  All  qi:j  = 1.  Pl3  = 0 •nd  p23  ^c**eases- 

The  ef effect  of  p increassing  from  0 to  1 is  the  same  as  q 
23 

decreasing  from  1 to  0 in  Fig.  5.5*.  P2j  > 1 we  can  see  there  is  4 
minimum  point  in  the  overall  mean  value  and  then  * increases  again  until 
it  reaches  1.  This  can  be  explained  from  the  expression  of  the  derivative 
of  F (]f_)  with  respect  to  z,  From  (5-9)  it  is  obtained 

dF  &f  dYi3  dy23 

ir=-fl3~5S^  S ~ + f23  a* 

The  utilization  factors  were  calculated:  = 0.53  and  = 0.U0 

and  the  derivatives  of  &13  and  t ^ with  respect  to  z are  straightforward 

from  (5-30)  and  0-31)  yielding: 

1Z = 0.53  (-2.8846)  * 0.40  (2.4038)  = 

dz  d*13  23 

= - 1.5384  ♦ 0.9615  -4|-  (5-31a) 

d*13  ^3 

where 

dF  1 .1 (5-3  lb) 

"5T  = ~F~  ’ 7?^?" 

The  expression  (5-32b)  is  represented  in  Fig  5.8a. 

From  the  observation  of  equations  (5-30).  (5-31)  and  (5-32)  we  can 
see  how  the  variation  of  the  optimum  z is  going  to  be  when  p23  ( or 
equivalently  6^)  increases. 


g variables  and  F in  terms  of 
min 


Fig.  5.8a.  Variation  of  the  first  derivative  of  the  average  queue  length  in  terms  of 


* : ' ' 


For  p » 0 ( <5_  = -1)  we  obtain  z*  = 0.24  and  thus  3 = -5.49 

23  * 13 

and  J 3 -3.75  so  that  the  expression  of  dF/dz  in  (5-32a)  is  null. 

If  p^  increases,  say  p ^ 3 0.2  ( 6^  * -0.8)  for  the  same  value 
of  z = 0,24  the  values  of  3^  are  from  (5-30)  and  (5-31) i 


*13  * ~5,30 


*23  = •3. 08  yielding 


-ffi—  = 0.0066  >0  for  8 = 0.24  and  = -0.8 

dz  2 

The  derivative  dF/dz  being  positive  means  that  the  length  increase 

rate  in  queue  x^(t)  due  to  the  input  increase,  is  greater  than  the 

corresponding  to  queue  x^(t)  80  that  in  order  to  minimize  the  total 

effect,  more  messages  are  sent  from  node  2 to  node  1 (z*  decreases) 

As  keeps  on  increasing  both  3^  and  3^  increase,  the  latter 

one  more  (see  (5-30)  and  (5-31))  so  that  for  some  value  of  6 , 39., 

becomes  positive  whereas  3^  increases  too  but  remains  negative. 

From  Fig  5.8a  it  can  be  seen  that  for  this  situation  dF/  »13 

increases  and  &F/  _ decreases  for  (3  increasing  so  that  dF/dz  will 

C.J  c 

be  negative  and  z*  will  have  to  increase  in  order  to  reach  the  minimum. 

For  example  for  p ^ ~ 1.2  ( 6 = 0,2)  the  optimum  z*  is  z*  = -0,10 
and  the  corresponding  3^  *nd  J are  from  (5-30)  and  (5-31). 

= -3.36  323  = -0.54  so  that  dF/dz  is  null 

If  p0~  increases t pP->  = 1,4  ( <f  = 0.4)  for  the  same  value  of 


z » -o.lO  tha  values  of  3^  and  are 


313  3 -3.17 
L = -0.0080  < 0 


y23  = 0.13 

for  z = -0.10 


yielding 


62  = 0.4 
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The  derivative  dF/dz  being  negative  means  that  the  length  increase 
rate  due  to  the  increase  of  p ■ is  greater  in  queue  x.^(t)  than  in 

queue  X2^(t)  and  therefore  more  messages  have  to  be  sent  from  node  1 
to  node  2 (z*  increases).  This  change  of  behavior  of  z*  occurs  when 
queue  X£^(t)  becomes  too  loaded  (above  half  the  full-capacity).  Ehen 
this  is  the  situation  and  the  input  traffic  at  node  2 increases  more, 
the  increase  of  the  queue  length  is  more  reflected  on  queue 
(which  is  below  half  the  full-capacity)  than  in  x^t)  precisely 
because  of  the  upper  barrier  for  the  queues  which  causes  the 
corresponding  queue  length  to  be  of  the  form  shown  by  Fig  9,4  and 
therefore  for  > 0 the  rate  of  length  increases  is  slower. 

The  next  figures  5-9  to  5-19  are  shown  for  the  same  example  of 
Fig.  5.2.  but  for  other  values  of  and  that  is  for 


*23  ■ 0-4 


12 

= 0.6, 


*13  * °-8 

*3 

and  Uq  = 0.3  and  the  same  value  for  all  = 0,75 
The  covariance  matrix  per  unit  time  is  now 


u^3  = 0.6  , u\z  = 0.5 


A = 


and 


[: 
[ 


0.86 

-0.96 

-0.96 

0.99 

-3.1501 

1.5916 

1.5916 


And  the  utilization  factors 

= 0,73,  J>  = 0,60,  greater  than  the  former  ones.  For  this  reason 
the  overall  mean  value  is  greater  for  this  example 


Fig.  5.9.  Example  5.1.  Routing  variables  and  F in  terms  of  q 


Fig,  5»10«  Example  5*1«  Routing  variables  and  F in  terms  of  q 
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5.12.  Example  5.1.  Routing  variables  and  F in  terms  of  q 

min 


>*W4fc 


*E.  5.13.  toe  ample  5.1.  Routing  variables  and  F in  terms  of  p 

min 


5.2,-  Example  with  four  queues 


Assume  a 3-node  network  as  shown  in  Fig,  5.15 


Fig  5.15*  Network  of  three  nodes,  3 sources  and  2 destinations 


Nodes  1 and  2 are  sources  and  receivers  and  node  3 is  only  source 
so  that  messages  a^,,  go  from  1 to  2 via  c^  or  c and  c ^ and  similarly 
for  a2^.  At  node  3 messages  go  either  to  node  1 via  c^  or  to  node  2 
via  c^g.  Therefore  we  have  one  queueing  process  at  node  1:  x-j^t),  one 
at  node  2»  x^(t)  and  t**°  at  nodes  3 x^(t)  and  x-^t)  as  in  Fig  5.16. 

According  to  section  4,4  the  capacities  and  traffic  rates  are  of 


the  form  specified  in  (4-28),  (4-29)  and  (4-30),  The  system  of  equations 
(4-31)  is  now 
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Fig  5«l6s  Network  of  three  nodes.  Detail  of  queues  at 
each  node. 
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and  the  equations  (^*— 32 ) where  the  constants  have  been  taken 
equal  to  1 for  the  same  reasons  as  in  Section  5*1 

P12  + 731  " 7i2  " y13  * ^12 
?21  + *32  ' *21  * *23  = ^21 

P31  + *23  * *31  “ *32  s ^31 

p32  + *?3  - *31  * *32  = ^32 

The  expressions  of  the  covariance  matrix  elements  arej 
From  (**-35) 

«(12),(12)»«U  * ♦ 0U(1-Df3> 

<X(21).(21)S  0t22  - A2l(l-*2l)  ♦ °32<1-u32)  * U21<1-t,21)  * B23(1-'J23) 

a(31).(31)S«33  * V^V  + U23(1-D23)  * “31(1-031>  ♦ °32<1-°32> 

«(32).(32)S«W  - *32<1-*32>  ♦ D13(1-t'l3)  ♦ ♦ U32tl-U32) 

From  (**-36) 

*(31), (32)  5 *3**  = ’U31  U31  ’ U32  u32 
From  (**-37) 

«<21).<31>  S «23  - -"23(1  - - ^2> 

<*(12), (32)  = *1*  * "U13(1  * “is*  ' Un(1  ■ U3l' 


(5-33) 
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From  (4-3 8) 


*(12), (21)  E *12 


0 


*(12), (3D  5 *13 
*(21), (32)  = *24 


31 

f 

32 


D 

U 


2 

31 

1 

32 


Then 


ot 

11 

0 

*13 

*14 

0 

*22 

*23 

*24 

*13 

*23 

*33 

*34 

*14 

*24 

*34 

*44 

(5-34) 


with  the  former  expressions  for  each  element. 

To  minimize  (4-39)  we  have  to  take  into  account  the  relationship 
among  the  . From  (5-33): 


^12  + ^21  + ^31  + ^32  = (p12'y12}  + (p2ry21}  + (p31*y31)  + 


+ (p32-y32) 


035) 


From  (3-7)  * A = “ A JL 

2 


Therefore  (5-35)  becomes 


1 

2 


(5-36) 


= (Pl2  - *12*  * (P21  - y21>  + (P31  - 3^3! ) (P32  - y*2} 


The  expression  (5-36)  is  a hyperplane  in  the  ^T- space  and  the  optimum 
ft  has  to  be  on  it*  From  (5-3*0  the  coefficients  of  5^  in  (5-36)  are  non- 
negative so  that  the  constraint  (5-36)  will  have  a smaller  minimum  when  the 

111  2 

right  hand  side  is  more  negative , that  is  when  y ^ 4,1(1  ^32  taJce 

on  their  maximum  value.  From  the  capacity  constraints  (**-3*0 


^ q12  1 y21  ^ q21 
€ q31  ' *32  ♦ « q32 


Therefore  the  maximum  values  are t 


(5-38) 


(y!2}  max  = qi2  S 

* q21 

(5-39) 

^y31^  max  = **31  * 

=q32 

and  from  (5-36)  and  (5-39) 

2 1 
y31  " y32  - 

0 

(5-*+o) 

Thus  we  are  left  in  the  minimization  of  (4-39)  over  the  eight 

p T 

components  of  ^ with  only  two  of  them  y£^  and  y^,  the  other  six  being 
given  by  (5-39)  and  (5-40), 

The  expression  of  the  elements  of  (5-33)  becomes  then 
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Ao  = (P-i«»  “ ” y' 


12 


12  h127  j13 


^21  “ (Pn  " ^ “ y? 


21  h21 


'23 


^31  = (p31  " q31*  * y2: 


(5-41) 


23 


^32  = (p32“q32)  + y 


13 

expressions  similar  to  (5-22)  of  the  former  example. 

In  this  case  the  expression  of  the  elements  of  V_  = 2 /\  is  not  so 
straightforward  because  it  is  a 4 x 4 matrix. 


Let 

us  take  some  values 

for  the  traffic  rates 

and  capacities 

*12 

3 

0.85  * 

4 ’ 

0.75  * 

U13  = 

0,40 

*21 

- 

0.60  * 

<4  ■ 

0.70  t 

u23  - 

0.25 

*31 

- 

0.45  ; 

4 = 

0.35  5 

U2  = 

31 

0.30 

*32 

~ 

0.25  * 

2 

U32 

0.35  » 

u32  - 

0.35 

and 

c = 

: 0.75  for 

all  (ij) 

which  satisfy  the  flow  equations  (5-' 

ij 

the 

capacity  constraints. 

The 

covariance  matrix  is  then: 

r— 

0.765 

0 

0,105 

-0.450 

A 

0 

0,865 

-0.415 

0.2275 

(5-42) 

S 

0.105 

-0.415 

0.89  0 

-0.3325 

-0.450 

0,2275 

-0.3325 

0.9250 

and  the  corresponding  V =*  2 /V 


-1 


3.7683 

-0.4881 

0,0665 

1.9772 

-0.4881 

3.0710 

1.2922 

-0.5283 

0.0665 

1.2922 

3.1596 

0.8503 

1.9772 

-0.5283 

0.8503 

3.5596 

In  (4-41)  call  for  convenience 


“ qi2  = ^1 


P21  " q21  = ^2 
P32  ~ *32  = <$k 


P3I  ” ^31  = ^3  P32  “ q32  = <$U 

from  (3-7)  and  (5-41)  we  have 
tf12  = 3.7683  c5x  - 0.4881  + O.O665  <53  + 1.9772  6 ’4 


- 1.7911  y^3  + 0.5546  yJ3 


5 = -0.4881  6l  + 3.0710  <52  ♦ 1.2922  63  - 0.5283  6 u - 


- 0.0402  y^3  - 1.7788  y^ 


tf31  = 0.0665  61  + 1.2922  62  + 3.1596  <$3  + 0.8503  6h  + 

♦ 0.7838  y^3  ♦ I.8674  y* 

= 1.9772  - 0.5283  <5^2  ♦ 0.8503  <53  3.5596  6U  + 

♦ 1.5824  y^3  ♦ 1,3786  y|3 

and  the  minimization  of  (4-39)  is  carried  over. 


(5-44) 


(5-45) 
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In  the  next  figures  from  5.17  to  5.16  several  results  are  shown 
when  one  (f  varies,  the  others  being  held  fixed: 

Fig  5.17  : The  effect  of  q^2  varying  between  0 and  1 is  shown.  It  can  be 
seen  that  when  q^  decreases  y^2  increases  that  is  when  the  capacity  of 
the  channel  1-2  decreases  more  messages  are  sent  from  1 to  2 via  node 

3. 

Fig  5,18:  Now  q21  varies  between  0 and  1.  The  effect  when  q21  decreases 
is  to  decrease  the  rate  of  messages  that  go  from  l-*3  *•2,  that  is  y^ 
and  to  increase  the  rate  of  messages  from  2 — * 3 — 1 because  the 
capacity  q21  of  the  direct  link  decreases. 

As  earlier  in  section  5.3  the  overall  mean  increases  when  the 
capacity  decreases. 

Fig  5.19:  When  q^  decreases  y^  decreases  too  in  order  to  compensate  for 
the  increase  of  the  drift  in  x^(t), 

2 

Fig  5.20:  When  q^2  decreases  y ^ has  to  decrease  to  compensate  this 
effect. 

3 

Fig  5.21:  The  effect  of  q12  decreasing  on  y12  is  null  until  q^  = 0.1701. 
From  this  point  on  y*  = q.^  and  overall  mean  value  Fmin  increases 
slightly.  This  effect  is  similar  to  that  of  Fig  5.5.. 

2 

Fig  5,22:  Similar  to  Fig  5.6.  There  is  no  effect  on  y^  when  q 
decreases. 

Fig  5.23 : Now  the  capacities  q^  are  held  fixed  and  the  input  p^2 


Routing  variables  and  F in  terms  of  q 

min 


Fig.  5.18.  Example  5.2.  Routing  variables  and  F in  terms  of  q 


Fig.  5.22,  Example  5*2.  Routing  variables  and  F . in  terms  of  q 





increases.  For  p12  bet ween  0 and  1 the  effee t is  the  iw*  ss  in  Fig  5.17 

2 

when  q12  varies  between  1 and  0 that  Is  y increases  up  to  its  maximum 

13 

value  q ■ 1,  At  this  saturation  point  F . increases  fastar. 


Fig  5«2<*>  Tha  input  p2j  incraasas.  The  Sana  affaot  as  in  Fig  5.W  for  p^j 
between  0 and  1.  Beyond  p^  a l,y^  kaaps  on  increasing  up  to  soma  value 
and  than  daer«asas  vary  fast.  This  affaet  is  sinilar  to  tha  ona  was  shown 


and  p ineraasa  respectively.  Sinilar  to 


decreasing.  In  both  easas  y, 


until  it  raachas  0 and 


Diffusion  approximation  for  computer  load  thar 


Tha  general  nodal  described  in  Section  b,l  for  massage  routing  in  a 


computer  network  can  be  also  applied  to  tha  load  sharing  problem  among  a 


system  of  computers.  References  for  this  topic  are  given  in 


The  goal  in  a loaded  sharing  system  is  to  increase  the  processing 
capabilities  of  a single  computer,  so  that  if  transmission  channels 
interconnecting  several  computers  are  provided,  tha  overall  system 
performance  can  be  increased  by  taking  advantage  of  tha  computer  different 
loads.  For  instance  if  one  computer  in  tha  system  becomes  more  loaded  than 


the  others,  it  makes  sense  to  process  some  of  its  incoming  messages  at 
other  distant  computers  that  are  less  loaded.  Therefore  swne  messages 
arriving  at  computer  A will  be  sent  to  some  other  computers,  processed 


Routing  virltbUi  and  F In  t*r»»  of  p, 


Routing  variables  and  F In  terns  of  p 

A 


there  and  sent  back  to  their  origination  point. 

The  problem  is  similar  to  the  routing  caso  wo  eonsidered  only  the 
transmission  channels  as  tho  sonrors  in  tho  different  queues,  for  tho  load- 
sharing  caso  wo  have  two  difforont  typos  of  sonrors,  tho  tranwlssion 
channels  and  tho  processors  thorn solves.  Therefore  there  will  bo  a distinction 
between  tho  transmission  queues  (in  both  ways i forwards  for  tho  programs 
that  have  to  bo  processed  in  tho  distant  computer  and  backwards  for  tho 
results  that  come  out  from  tho  computers) 

Tho  model  that  was  established  in  section  4,1  can  bo  applied  hero  by 
considering  queues  and  nodes  associated  with  them  so  that  they  are  connocwod 
by  "links"  which  can  either  represent  transmission  channels  or  processors. 
This  is  the  general  formulation  for  the  Statistical  Load  Sharing  Problem' 

£26,  chapter  4,3  ] , 

The  load  sharing  is  formulated  as  a multicommodity  flow  problem  in 
through  the  network  has  to  be  found  for  fixed 


that  Wunderlich  suggests 


which  the  optimal  flow 
capacities  and  given  inputs. 

To  see  how  the  model  of  section  4,1  can  be  applied  to  a load  sharing 
computer  system  consider  the  following  examples  (Fig  5.27) 

There  is  a system  of  two  computers  called  1 and  2 which  are  connected 
by  two  transmission  channels  of  capacities  1^  and  1^,  The  Jobs  entering 
computer  1 for  example  are  queued  up  forming  the  queueing  process  x^(t). 
They  can  be  served  either  by  the  computer  1 (and  upon  servicing  leave 
the  system)  or  can  be  transmitted  by  channel  1^  to  the  other  distant 
center.  There  they  wait  at  queue  x^(t)  until  its  turn  comes  and  are 
processed  by  computer  2.  After  being  processed  they  enter  queue  x (t)  and 


Fig  5.2?.  Load  sharing  axanpl*  between  two  coo pu tars 


: >T 


wait  their  tom  for  tranmisston  to  their  origination  point  via  ehannal 
\2»  It  can  bo  similarly  uid  about  tho  mimim  entering  oomputer  2.  As 
wo  Mid  oarlior  thoro  oro  two  typos  of  of  queues  processing  quouo*  and 
communication  quouos. 

In  ordor  to  approximate  thla  esse  by  a dlffualon  proeoaa,  lot  ua 
consider  tho  time  divided  in  stall  Intervals  (t,  t ♦ /^t)  and  tho 
messages  composed  of  snail  blocks  of  duration  ^t.  ^hiring  this  internal 
we  call 

a^  * ?rob.  that  a message  of  length  A*  enters  at  computer  1. 

a*  - Prob.  that  a message  of  length  At  enters  at  computer  2. 

b ■ Prob.  that  a message  of  length  At  waiting  at  x^t)  is  processed 

1 by  computer  1. 

e » Prob.  that  a message  of  length  At  waiting  at  x (t)  is  transmitted 
^ through  channel  1 to  comjmiter  2 and  enters  queue  x^(t)  to  be 
processed  • 1 

b'  = Prob.  that  a message  of  length  At  waiting  at  xfe(t)  la  processed 
1 oy  computer  2. 

c{  = Prob.  that  a message  of  length  At  waiting  at  x (t)  Is  transmitted 

1 through  channel  1 to  computer  1 and  enters  queue  x^t)  to  be 
processed 

b2  = Prob.  that  a message  of  length  At  waiting  at  Xj(t)  is  proeersed 
by  computer  1 and  enters  queue  x^(t)  to  be  retransmitted 

c = Prob.  that  a message  of  length  At  waiting  at  x (t)  Is  transmitted 

2 to  computer  2 and  leaves  the  system.  * 

b*  = Prob.  that  a message  of  length  At  waiting  at  x (t)  is  processed 
2 by  computer  2 and  enters  queue  *6(t)  to  be  retransmitted . 

e'  » Prob.  that  a message  of  length  At  waiting  at  x^(t)  is  transmitted 
2 to  computerl  and  leaves  the  system 

The  computer  service  processed  are  represented  by  and  r2,  the 
computer  capacities  and  defined  as  the  maximum  processing  probabilities  of 
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. "T 


A message  of  longth  At  during  (t.U^O  At  oomputora  1 And  2 reapectlvely. 

The  ehAnnol  OApAeltloa  ir«  and  defined  aa  the  maximum  probability 
thAt  a message  of  length  At  is  tranmaltted  through  tho  respective  channel 
during  (t.uAt). 

According  to  this  the  computor  processing  constraints  ato 

♦ b2  $ end  b£  ♦ b£  ^ (5-b6) 

And  tho  eh Ann *1  capacities  constraint* 

♦ c2  ^ 1^  And  ♦ c2  ^ 12  ( 5-^*7 ) 

Aa  it  can  bo  toon  computer  1 processes  its  om  Jobs  irlth  probability 
b^  and  Jobs  from  tho  othor  contor  with  probability  b^.  As  soon  as  a Job 
got*  through  tho  computor  it  eomos  out  and  waits  In  cato  it  has  to  go  to 
tho  othor  ond.  Similarly  for  computor  2. 

Tho  transmission  channels  aro  either  used  to  transmit  Jobs  to  bo 
processed  at  tho  othor  computor  (probabilities  c^  and  cp  or  Jobs  that 
have  boon  processed  to  their  origin  (probabilities  c2  and  cp 

In  order  to  us*  for  this  ca so  tho  general  expressions  that  were 
developed  in  section  4 this  model  will  b*  mad*  equivalent  to  that  of  Fig. 
4.1  by  adding  two  dummy  nodes  and  considering  general  capacities  for  the 
links  between  nodes  without  specifying  whether  they  ar*  refered  to  the 
computer  processing  capacities.  This  is  shown  in  Fig  5.28. 

As  it  can  be  seen,  computer  1 is  unfolded  in  two  nodes  1 and  2, 

Messages  enter  at  node  1.  The  "channel"  1—2  represents  the  computer 

processing  so  that  c ^ * lj_.  Once  a message  is  served  is  goes  out  if  it 

was  local  or  waits  at  node  2 to  be  transmitted  to  its  origin.  The  capacity 

of  the  "channel"  2 — • 1 c * 1 because  the  only  queueing  process  for 

21 


! 


r« pr*s«nt«tlon  of  th*  I 


1 


a 


retransmission  Is  due  to  the  transmission  channel  whose  capacity  Is 
c^  ■ 1^.  Therefore  the  models  of  5. 27  and  fig  5.26  are  equivalent 

provided  thati 


x^tt)  » x^t) 

Xj^t)  ■ Xj(t) 

Xj^(t)  - X2(t) 

.^(t)  • *5(t) 

*24(t)  e X^t) 

*42(t)  * *6(t) 

”12  * rl  < 1 

*13  • h < 1 

•>*  r2  <l 

e31  " l2  < 1 

*12 '*1 

*>'*i 

“L-h 

u34  ■ bi 

“l2“b2 

“13  " *1 

4 , 

"3i  * *i 

2 

u„ 

21 

4 3 

- u13  - u£3  - c2 

u2  - 
<»3 

“3i  ■ “si  • •; 

The  capacity  constraints  arei 

“l2  - “12  * “12  1 

u 

>4 

“jl»  S ej» 

(5-“«) 

"l3  * “l3  * *13  ' 

4 

u ♦ 

31 

“31  < *31 

(5-b9) 

and 

uj  ^ 0 for  all 

k 

UiJ 

(5-50) 

The  capacities  and  traffics  are  assumed  of  the  formi 

V At 


Cij  * Cij  4 qiJ 


*1 j a Aij  * pij  ^ At 

U1J  3 4 A)  ' 


- 


V(U) 


(5-51) 
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Ms  can 
From  (<*-32 ) 


obtain  th*  *xpr*ssion  of  tho  voetor  drift  components  ft 
( a s sun a th*  constants  ■ 1 as  in  th*  former  sections) 


* „2  2 

*12  * P12  " y12  “ y13 

- u u 

*14  • y3i  - y12 

- 4 4 

£24  • yi2  - yi3 

. 4 4 

J0}4  * P34  • y34  * y31 


(5-52) 


*}2  * y13  * y3<* 

2 2 

P 42  * y34  " y31 


Expression  of  th*  covariance  matrix  elements 
From  (4-35) 

<X(12)a2)  5 \x  - *12<1'*12>  * "L<1-u212>  * »W>> 

a(14)(14)  = °<22  * U31^1‘U31)  * U12^1“U12) 

«<24)(24)  S «33  * U12(1*U12)  4 U13U-U13) 

«(  343(34)  5 «44a  4 U34^“U34^  ♦ u31^1“U31) 

*(32)(32)  s *55  * Ui3(l-Ui3)  ♦ u^l-u^) 

*(42)(42)  5 «66  ’ U34<1-°34)  4 U31^“U31> 

From  (4-36) » <*(12)(14)  - *12  * "yi2  U12 

From  (4-38)  and  (4-36)  (Remember  = u^*) 


°^12)(24)  = *L3  3 Ul2  U12  “ U13 


From  (4-38) 

*(12)04)  5 *L4  = 0 

From  (4-37) 

*(12)(32)  5 *15  3 ’U13(1  " U13) 

*(12)(42)  = *16  " 0 

_ 4 4 

*(14)(24)  = *23  = U12{1  ' U12> 

*(14)(34)  5 *24  3 "U31(1  ” U31} 


From  (4-38) i 


*(14)02)  = *25  = ° 

_ 2 4 

*(14)(42)  5 *26  = U31  U31 

From  (4-37) 


*(24)04)  = *34  * 0 

From  (4-38) 


*(24)02) 
*(24)(42) 
From  (4-36) 

*04)02) 


*35  3 l13  U13 
*36  0 
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From  (4-38)  and  (4-36)  (Remember  u 43  ■ u31)  ' 

<X(34)(42  ) 5 *46  * U34  U34  • °31  U31 

From  (4-3?) 

*(32)(42)  5 *56  “ ’°31*a  * U34} 

Then 


*11 

*12 

*13 

0 

*15 

0 

*12 

*22 

*23 

*24 

0 

*>6 

*13 

*23 

*33 

0 

*35 

0 

0 

*24 

0 

*44 

*45 

*46 

*15 

0 

*35 

*45 

*55 

*56 

0 

*26 

0 

*46 

(5-53) 


The  flow  equations  are  (from  (4-31) 

*12  * °12  - "13  * ° 

U 4 

U31  “ U12  = ° 


4 4 

U12  - ,J13 

4 4 

^34  ” u34  “ U31 


(5-34) 


U13  - u34 


u34  * U31 


0 

0 


Subject  to  1 
2 4 

.4  2 

\ 

U12  4 i2 

2 4 

< C12 

1 

u34  4 u34 
4 2 

* % 

► (5-55) 

"u  ♦ °i, 
.11  ojj  =s  0 

< C13 

1 

°31  4 U31 

S c3l 

As  we  did  In  the  preceding  examples,  we  assume  values  for  C , A and 
k J v 

that  satisfy  (5-5^)  *nd  (5-55)*  For  given  Inputs  p and  capacities 

k 

q^.  we  want  to  find  the  set  of  y that  minimise  the  overall  mean 
constrained  byj 


2 2 

y,-,  4 ^ q 


1 

12 

1 

4 

*34 

2 

4 y34 

« ly, 

13 

t 

4 

y31 

2 

4y31 

« o31 

(5-56) 


for  all  y*  ^ 0 

summing  up  both  sides  of  ( 5—52 ) i 


all 

pairs  (ij) 


From  (3-?) 

6 


/ 2 2 U 2 » 
Aj  - p12  4 p3**  - (*12  4 y3*  4 y13  4 y31  ) 
ij) 

'-?>  A 1> 


(5-57) 


(j  E **11  ^ ^12  4 l2  X 4 ^2  Xi  ^*3^  ^24 

1=1  1*1  1*1 

4 ^ i^l  ^ + (2  U1  ^32  * (2  Xi 


2 2 4 2 

= Pi2  4 P34  " <*i2  4 *34  4 *13  4 *31 ) 


(5-58) 


99 


From  the  expressions  (^-53)  it  can  be  scan  that  not  ail  tha 


eoafficiants  of  tha  in  (5-58)  hava  to  ba  positive.  Tharafora  wa 


2 2 4 2 

cannot  assume  that  tha  optima  values  for  y._,  y-^,  y.-,  yn.  ara 


ri2*  7iy  J3i 

tha  maximum  ones  that  ia  q12,  q^,  q^»  q^  raapactivaly. 

The  minimisation  of  (**—39)  has  to  ba  carried  over  all  tha 
components  of  tha  vector  ^ i 


,2  4 2 4 4 2 4 2 . T 

z * (y,?.  y-y,.  y-.-,.  y-n*  y12.  y^.  y.v  *11' 


'12*  ■/34'  Jr13‘  J31*  J12*  /3U*  J.3’  *31 

Let  us  assume  an  example.  Suppose 
A12  » 0.8  C12  * 0.75  C. 


'13 


0.50 


a 0.50 


C3U  = 0.75 


'31 


0.50 


that  is, the  computer  capacities  are  greater  than  the  transmission 
channel  capacities  and  computer  1 is  more  loaded  than  computer  2. 
The  set  of  values 


UL  - 

0.50  * 

U2  a 

13 

2 2 
v - V 

= 0.30 

4 

4 

4 4 

u34  = 1 

0.40  j 

U a 

31 

°12  • u13 

a 0.20 

satisfy  (5-54)  constrained  by  (5-55)*  ' 

Thus  the 

matrix  A.  is  determined 

0.62 

-0.05 

0.02 

0 

-0.21 

0 

-0.05 

0.18 

-0.09 

-0.09 

0 

0.03 

0.02 

-0.09 

0.18 

0 

0.03 

0 

A = 

(5-59) 

0 

-0.09 

0 

0.58 

-0.12 

0.09 

-0.21 

0 

0.03 

-0.12 

0.42 

-0.21 

0 

0.03 

0 

0.09 

-0.21 

0.42 
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Several  cases  are  shown  In  the  next  figures i 


Consider  Fig.  5.29 » The  inputs  p._  ® p ■ 0 and  the  capacities  q ■ q„  • 

1C  12 

■ q31  " 1 whereas  varies. 

For  q^  ■ 1 we  obtain  the  optimum 

2 4 2 , 2 4 42 

y12  “ y34  * y31  * 1 1 y13  * y31  * y12  * ^34  * 0 

4 

and  y^  * 0.8141.  As  q^  decreases  nothing  happens  until  q^  ■ 0.8141.  From 

this  point  on  y^  * q^  end  because  of  this  decreasing  in  the  capacity  the 

overall  mean  F starts  to  increase  considerably, 

min 

Fig  5. 30 1 q^  varies  and  the  other  parameters  are  held  fixed.  Now  we 
obtain 


yi2  " y34 


y31  - q31 


2 4 4 2 4 

y ss  y^  * y^2  = y-j^  = 0 end  y^  decreases  with  q^  decreasing. 
This  can  be  explained  from  the  fact  that  if  the  capacity  of  the  link 
between  computer  2 and  1 decreases,  less  messages  have  to  be  sent  from 
computer  2 to  computer  1 and  therefore  less  messages  have  to  come  back. 

The  consequence  of  q^  decreasing  is  an  increase  of  the  overall  mean 

Fig.  5.31»  All  q = 1 , p^  = 0 and  p^  increases  that  is  computer  2 starts 

^ 2 4 2 2 4 4 

being  more  loaded.  It  is  obtained  y^  = y3u  * y31  1 11  yl3  ” y31  * 712  ' 

2 4 

s y =0  and  y, _ increases  from  0.8141  up  to  It  messages  coming  back 
'34  13 

to  computer  2 have  to  do  it  faster. 


5.32t  All  q^  = 0,  p^  = 0 and  p^2  increases.  The  effect  is  the 


fig*  5*30.  bxample  5.3.  Control  variables  and  F . In  terms  of  q_. 
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opposite  to  that  of  the  previous  figure  that  is  decresses.  The 

oversll  mean  increases  more  than  in  the  former  case. 

Let  us  assume  now  that  the  capacities  of  the  transmission  channels 
are  greater  than  those  of  the  computers.  For  example i 


*12 

a 0.60 

1 « 0.50 

1 C13  * 

0.75 

*34 

= 0,50 

» c34  0.50 

1 C31  » 

0.75 

The  set  of  values: 

UL 

= 0.40 

1 °13  * 4*  * 

U31  = 0.20 

4 

4 4 

4 

U 

3^ 

= 0.20 

» °31  s U12  = 

0 = 0.10 

satisfy  (5-54)  and 

(5-55).  The  matrix  /\  is 

0.64 

-0.04  0.02 

0 

-0.16 

0 

-0.04 

0,18  -0.09 

-0.09 

0. 

0.02 

0.02 

-0.09  0.18 

0 

0.02 

0 

A * 

(5-60) 

0 

-0.09  0 

0.46 

-0.04 

0.02 

-0.16 

0 0.02 

-0,04 

0.32 

-0.16 

0 

0.02  0 

0.02 

-0.16 

0.32 

The 

same  cases  are  plotted  in  the  next  figures. 

.Ja.231  For  P12 

= P34  0 °»  *12  * 

q34  3 q31  * 

1 and  q^3  varying  it  is 

obtained: 

2 4 

2 

2 4 

4 2 

y!2  * y34  " y31  * 1 1 

y13  * y31 

3 y12  3 y34 

3 0 

Fip.  5.33.  Example  5.3.  Control  variables  and  F in  terms  of  q 

min 
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and  y*  * ^13 • Th*  ov«**»ll  mean  increases  for  q^  decreasing. 

Fig.  5.34:  For  P12  " P34  * 0 * *12  * qJU  * q13  " 1 "**  q31 

wa  obtain 

2 4 2 4 4 2 n 

y12  * y34  * 1 * yi3  * y31  “ yl2  " y34  * 0 

9 U 4 

y~  * q31  41x1  *13  = 1 for  q3i  3 1*  As  q31  decr®»se*  Fy  remains  tha  Sana 

33  4 

up  to  some  value  of  m 0,8  at  which  y^  decreases. 

Compare  Figs.  5*29  and  5*33  and  Figs.  5*30  and  5*34.  Similar 

behavior  is  observed.  In  these  cases  the  overall  mean  is  less  than  in  the 

former  ones  because  both  computers  are  less  loaded. 

Fig.  5.35»  q12  = q3U  = q13  = q3i  = 1 » P12s0Md  P 34  increases. 

It  is  obtained: 

2 4 4 2 , .2442 

yl2  = y34  * y13  = y31  = 1 40(1  y13  = y31  s y12  • y34 


' 

f 


I i 


Fig.  5.36:  q12  = q^  = q13  * q?1  ■ 1 I * 0 and  p12  increases.  It 

is  obtained: 

2 4 2 . 4 2 4 

y12  ■ y13  - y31  - 1 1 y12  * y13  ■ y31  * 0 

4 2 

and  at  some  value  of  P12~  0.2  y^4  starts  decreasing  from  1 and  y^4 

4 2 

starts  increasing  from  0 such  that  y^4  ♦ y^4  = q^4  = 1.  That  is  computer 

4 2 

2 processes  more  jobs  from  computer  1 until  y^4  * y^4  = q34y2  = 0,5  . 
This  load  sharing  in  this  case  can  be  explained  from  the  fact  that  now 
the  transmission  channels  are  faster  than  the  computers.  In  Fig.  5.32 
there  was  not  such  effect  because  the  computer  were  faster.  One  can  also 


Example 


Fig.  5.?6.  Example  5.3.  Control  variables  and  Fnin  In  t®rms  of  p12 


6.-  COMPARISON  OF  THS  DIFFUSION  MODEL  WITH  THE  M/M/l 


The  model  M/M/l  has  been  extensively  used  to  study  networks  of 
queues  because  of  its  mathematical  tractability  £llj  . Its  attractivness 
stems  from  the  fact  that  the  interarrival  and  service  times  are 
exponential.  This  and  the  assumption  of  infinite  buffer  capacity  lead  to 
simple  expressions  for  the  distribution  in  steady-state.  For  y/M/l/N 
queues  that  is  for  finite  buffer  capacity  N,  the  mathematical  analysis 
becomes  much  more  complicated  £7,  12 J , Therefore  in  order  to  compare 
the  constinuous-state  diffusion  model  developed  in  the  preceeding 
sections  for  computer-communication  networks  with  a discrete-state  model, 
M/M/l  queues  will  be  assumed. 

The  comparison  between  both  models  will  be  made  first  for  a single 
queue  and  then  for  the  network  analyzed  in  Section  5.1  with  two  queues. 


6.1.-  Single  queue 


Consider  a single  M/k/1  queue  with  input  rate  A and  service  rate 
The  steady- state  distribution  is  s ^7j 


pn  = U - Tf)  (}T)n  * n = 0,1,2,... 

^ A < /A 


and  the  mean  value 


\ 

/xr 


(6-1) 


(6-2) 


Consider  now  the  diffusion  queue  x(t)  with  capacity  N messages, 


i 
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and  where  yj  and  oC  are  respectively  the  mean  and  variance  per  unit  time 
of  the  process  x(t). 

As  we  saw  in  Section  ^.1  the  number  of  messages  in  the  queue  is 
n(t)  » N x(t)  so  that  its  mean  and  variance  per  unit  time  respectively 


E l n(t) 


a N >S 


Var  [ n(t)J  = N2  Var  L x(t)3  _ N2( 

t 


(6-3*) 


(6-3b) 


For  the  M/K/l  queue  the  mean  and  variance  per  unit  time  are 


Var  [ n(t)]  = \ + u 


(6-4* ) 


(6-4b) 


Therefore  the  diffusion  queue  has  the  same  mean  and  variance 
per  unit  time  as  an  M/M/1  queue  whose  arrival  and  service  rate  are 


respectively 


^ (N  <x  ) 
2 

| (Not  -£  ) 


Provided  rt  < 0 


(6-5*) 


(6-5b) 


|P|  <N* 


Assuming  the  input  and  service  rates  given  by  (6-5)  l®t  us 
calculate  the  expression  of  the  mean  value. 


Substituting  (6-5)  into  (6-2)  we  obtain* 


ne  = 


N a + , 


-N  «- 


(6-6) 


P < 0 and  | y3(  < N ot 
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Lat  us  call  »d  the  mean  value  corresponding  to  the  diffusion 
queue.  Clearly  nd  * N x where 


( — a!  i ) 

e*  - 1 r 


(6-7) 


and  is  represented  in  Fig.  4.h  and  where  / = 2/3 /(*  (Remember  Sec. 3) 
Therefore 


nd  = N 


- * 
2fi 


♦ ^20/  ot) 


WMTT 

• • 1 


(6-8) 


For  < 2y9  / OC ) < -3  the  expression  (6-8)  can  be  approximated  by 


nd  SS  -N 


(6-9) 


Looking  at  (6-6)  and  (6-9)  we  can  see  that  for  (2/9 /o O < -3 
both  expressions  are  very  close  except  for  the  term  -(1/2)  in  (6-6), 
but  this  difference  becomes  paltry  as  N increases. 

For  -3  <(2/fl/cO<  0 the  exponential  term  in  (6-8)  becomes 
significant  and  cancels  the  pole  of  0C/2/J  at  /3=  0 whereas  the 
expression  (6-6)  becomes  unbounded  for  fi  = 0.  This  is  due  to  the  fact 
that  the  M/M/l  queue  has  infinite  capacity.  For  ^ >0  it  does  not  make 
sense  to  compare  n^  and  nd  because  for  JZ  > 0 there  is  no  steady-state 
for  the  M/M/1  queue  since  this  would  imply  \ > JJL  (See  expressions 

(6-5)). 

In  Fig  6.1  nft  and  nd  are  compared  in  terms  °*P  for  a fixed 
value  of  OC = 0.5  and  for  different  values  of  N. 


The  solid  curves,  corresponding  to  n do  not  become  unbounded 

d 


Fig.  6,1.  Average  length  of  a diffusion  queue  (solid  lines)  and  an  exponential 
M/K/l  queue  (dashed  lines)  with  the  same  drift  ft  for  different  size 
of  buffer  N, 


I 

I 


for  p « 0 but  thoir  value  at  this  point  is  the  corresponding  to  N/2, 
At  some  value  of  and  n#  intersect.  The  value  fiQ 

decreases  as  N increases.  Fory8<^  n#  differ  approximately 

in  \jz  as  we  saw  until  [^j  » Not  in  which  case  * 0 since  this  implies 
X*  0.  For  N * 10  this  happens  for  5» 

Therefore  we  can  conclude  that  both  models  are  very  close  when 
the  M/M/1  queue  is  far  from  saturation  ( A = ) 


6.2.-  System  of  two  queues 


In  Fig.  6,2  it  is  reproduced  the  model  of  Fig.  5*2  where  the 
queues  n (t)  and  n^t)  are  of  K/K/1  type  with  the  indicated  arrival 
and  service  rates. 

The  arrival  and  service  processes  are  assumed  independent.  The 
expressions  for  the  means  and  covariances  per  unit  times  are 


E fnT(t)]  x 

-X— 1 - K * >*21  - h - >*12 

(6l0a) 

E [n2(t)l 

t = ^ + ^l12  * ” ,Hei 

(6-10b) 

Var  f n,(t)l 

----  - K * >*21 

w 

(6-10c) 

Var  [n«(t)l 

- t J - *2  * >*12  * >*2  * >*21 

(6-10d) 

Cov  ^(t)  n2(t)j 

‘ */*12  " M21 

(6-10e ) 

NODE  1 


NODE  2 


Fig.  6.2:  Network  of  three  nodes  and  two  queues 


For  the  diffusion  model  of  Section  5*i*  if  ih®  maximum  queue  lengths 


is  N^*  respectively  we  have. 


E [n  (t)]  E 

T 1,1  “ 

„ E 


t 

[*2u)] 


- h fii 


(6-lla) 


(6-llb) 


r [n2(t)] 
t 

[n2(t)l 


t 

•[x2(t)] 


"l*  *11 


N2  **22 


(6-llc) 


(6-lld) 
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Cov  [n  (t)n2(t)  1 Cov  [x],(t)x2(t) j 

- ^1^2  = N]_  ^ <X]_2  (6-llc) 


equating  expressions  (6-10)  and  (6-11)  we  obtain 
x N1 

\=—  (Nx  0Cn  ♦ fix)  - ^21  (6- 12a) 

N2 

X2  = ~ “ ^2  o(22  ♦ 0(^2  ♦ (6-llb) 

Hi  = **1*11  ’ A ) + N1N2  *12  4 /^21  (6- 12c) 

fX2  ~ ^n2«22  ” " H>21  (6-12d) 

>Hl2  = * NlN2  *12  " ^21  (6-12e) 


where  ^(21  can  be  chosen  freely  provided  the  others  are  not  negative. 

The  equivalent  arrival  and  service  rates  of  queues  n (t)  and  n (t) 

1 2 

are  respectively 


^1  * M2I 

' Mi  Mi  * M12 

(6-13 a) 

K 

’ K * /<12 

' Hz*  M2  * Ma 

(6-13b) 

therefore  the  corresponding  mean  values  ares 

n 

le 

Ai  ♦ f+21  N1  0(11+ 

*1  . 

Mi  ' 

Pi  + /*12  ^1  “ P'21 

- »,  0(11  - 

1 

(6-14«) 

2fi1  2 


4 
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A2  _ ^2  * /*12 

}\2  “ ^2  * /*21  ^2  ' /*12 


N2  °^22  * &2 

-2  A 


— N —2?  - i 


(6-14b) 


provided  that 

A < 0 

A <° 


Kl  < \ «u  <6'15*> 

lAi  < s2  *22  (<-1'o) 


For  the  diffusion  queues  the  corresponding  mean  values  are 


n,  , = N x.  = N — - 

“ 11  1 **.- 1 


n2d  * N2  X2  = N2 


eg*  - 1 


(6-16-a) 


(6-l6b) 


where  and  *2  are  the  components  of  the  vector  jf  = 2 /\  y3 


that  is: 


{ - 2 °^22  #1  " °*12  ^2 
°fll  °*22  “ <*122 


h - 2 


<*11  @2  " °^12  ^1 


(6- 17a) 


(6-17b) 


°*11  ^22  “ °*12 

'//hen  JT  and  are  less  than  -3.  the  expressions  (6— 16 ) can 

»1  *2 


be  approximated  by 


( 


1 ft 


“V- 


**22 

<*L2 


2 k 


(6— 18a ) 


n2d  ~ 


2 3 - 

^2 


(6- 18b) 


Compare  expressions  (6-15)  and  (6-18).  The  difference  new  is  not  only 
the  term  1/2  in  (6-15)  but  the  terms  affected  by  the  element  oC^  of 
the  covariance  which  did  not  show  up  in  (6-15). 

Let  us  take  for  instance  the  values  of  the  first  example  of 
Section  5*1»  that  is  OC^  = 0,56,  = 0.6k,  OC^  = -0,16  and 

assume  = 10. 

Take  6 - p^  - - -1  and  6^  = P-^  - variable.  The  value 

of  z*  that  minimizes  the  overall  mean  value  is  represented  in  Fig.  6*3 
as  a function  of  6 The  corresponding  values  of  and  are 
given  by  expression  (5-22)  that  is 

- 6 ^ - Z*  (6- 19a) 

^9^  - -f  z*  s -1  + z*  (6-19b) 


(6-19b) 


and  the  corresponding  an  ^ can  be  obtained  from  expressions  '6-1?) 
We  want  to  compare  the  expressions  of  the  means  corresponding  to 


the  diffusion  model  and  to  the  M/M/1  model  when  varies.  This 

is  depicted  in  Fig.  6,4.  The  values  of  TT,  and  TT  are  very  close 

dl  el 

whereas  nd2  and  n^  are  not.  This  is  due  to  the  fact  that  the 
pole  of  nel  corresponding  to  ^ » 0 occurs  at  6^  * 1 whereas 
the  pole  of  n occurs  for  6.  ■ 0,05  so  that  x*  ■ 1 and  A • 0 

1 r* 2 

In  the  same  figure  sum  of  the  mean  values  n *■  rT_  ♦ n and 

® 31  e2 

n,  = n ♦ n . Similar  conclusions  to  those  of  Section  6.1  can 
a al  a2 

be  drawni  the  diffusion  model  cancels  the  pole  corresponding  to 
zero  drift  due  to  the  inclusion  of  an  upper  barrier  that  prevents 
the  queue  length  from  increasing  without  limit.  As  the  drifts 
become  moire  negatives  the  mean  values  corresponding  to  both 
models  are  nearly  the  same. 


; 1 : -I 


Wmm 


'-.Ttr.-r.zzt: 


T~-t=r. 


‘ :':t  : 


wmm 


^rtrrrn 


Fig,  6.4.  Comparison  between  the  diffusion  model  results  (solid  lines)  and  the  M/K/l  model 
(dashed  lines)  for  example  5.1 • 


7.-  CONCLUSIONS  AND  SUGGESTIONS  FOR  FURTHER  WORK 


The  diffusion  approximation  can  be  useful  for  modeling  a computer 
communication  syrtem  because  it  allows  to  consider  the  queueing  processes 
like  if  they  were  of  continuous  nature  rather  than  discrete.  Therefore 
the  increase  in  the  number  of  states  for  complex  systems  can  be  avoided 


simplifying  then  the  mathematical  treatment 


In  Section  2 the  requirements  a process  has  to  satisfy  in  order  to 
be  approximated  by  a diffusion  process  was  established.  This  was  obtined 
as  the  limit  of  a random  walk  processes  when  the  size  of  the  steps  became 


very  small  as  well  as  the  time  intervals.  The  probabilities  of  jumping 


up  and  downwards  were  nearly  the  same,  the  difference  being  a quantity 
dependent  on  the  square  root  of  the  time  interval  and  tending  then  to 
zero  as  that  becomes  very  small. The  size  step  0 and  the  time  intervals 
At  were  related  by  an  expression:  At  = K 0 so  that  the  variance  of 


the  process  makes  sense. 

This  approximation  led  to  the  diffusion  equation  (2-5)  which  relates 
the  distribution  of  the  continuous-state  continuous-time  process  by 


mean  of  its  derivatives  with  respect  to  the  state  and  time.  Our  interest 
was  addressed  to  find  the  steady-state  distribution  which  gives  an  idea 


of  what  is  to  be  expected  in  the  long  run  and  after  the  transient 


period  has  died  off.  The  procedure  was  to  solve  the  diffusion  equation 
when  the  derivative  with  respect  to  time  was  zero  and  with  the  appropiate 


boundary  conditions 


The  same  can  be  applied  for  a multidimensional  diffusion  process 


representing  ell  the  single  diffusion  processes  that  take  place  in  a 
network  of  queues. 

It  is  to  be  remarked  that  the  boundaries  (called  “barriers"  in 
diffusion  literature)  come  from  the  physical  fact  that  the  queueing 
processes  represent  the  messages  waiting  to  be  served  and  therefore  a 
lower  barrier  must  exist  s nee  the  number  of  messages  cannot  be  less 
than  zero.  An  upper  berrier  was  provided  too  for  each  process  because 
finite  length  buffers  were  assumed. 

In  order  to  optimize  the  system  operation  a performance  criterion 
had  to  be  taken.  This  was  to  consider  the  sum  of  all  the  expected 
queue  lengths  whose  expressions  are  quite  straightforward  once  the 
length  distribution  is  calculated  via  diffusion  equation. 

In  Section  b a general  model  for  routing  messages  in  a computer 
communication  network  was  established.  Then  a procedure  to  calculate 
the  system  parameters  is  provided.  The  system  parameters  are  all  the 
coefficients  of  the  diffusion  equation,  na-nely  the  mean  per  unit  time 
of  each  queue  and  the  elements  of  the  covariance  matrix  per  unit  time. 

Once  the  system  parameters  are  known,  the  expression  of  the 
overall  mean  can  be  found  and  the  problem  consists  of  minimizing  that 
expression  by  properly  chosing  the  system  parameters  and  subject  to 
the  specific  constraints  of  the  problem. 

In  Section  5 several  examples  are  shown  for  ilustration  for 
systems  ox'  2,  b and  6 queues.  The  last  one  though,  is  a modification 
of  the  general  model  that  was  established  in  Section  b,  The  difference 
is  that  the  computer  network  is  considered  as  a computer  load  sharing 


system  rather  than  a general  routing  network.  Nevertheless  the  diffusion 
model  can  be  applied  to  this  case  too  by  considering  as  generalized 
"channels"  not  only  the  transmission  links  but  the  computer  processor 
themselves. 

Finally,  a comparison  is  made  between  the  established  diffusion 
model  and  the  exponential  M/M/l  for  a single  queue  and  for  a system  of 
two  queues.  The  main  difference  between  the  two  models  arises  from  the 
fact  that  the  M/M/l  has  no  limit  for  the  queue  length  and  therefore  a 
pole  appears  for  equal  arrival  and  service  rates  (null  drift).  The 
more  negative  the  drift  becomes  the  more  both  models  resemble  and 
this  resemblance  is  more  evident  for  larger  queue  capacity  N. 

Suggestions  for  further  work 

It  was  said  in  Section  h-,5  that  although  the  minimization  problem 
was  dependent  on  the  elements  of  JZ_  (vector  drift  per  unit  time)  and  A 
(covariance  matrix  per  unit  time)  we  considered  that  one  as  fixed  and 
carried  the  minimization  over  the  elements  of  This  was  because  the 
computations  involved  became  easier.  It  would  be  desiderable  to  accomplish 
the  minimization  problem  by  including  in  it  the  elements  of  _A_.  The 
difficulty  arises  from  the  fact  that  even  though  the  constraints  of  the 
problem  are  linear,  the  function  to  be  minimized  is  not  linear  but 
exponential. 

It  could  also  be  interesting  to  find  other  algorithms  for  the 
minimization  problem  that  take  advantage  of  the  system  structure  in 
order  to  investigate  and  eventually  provide  faster  convergence. 
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